Nov 28 00:34:57 user devstack@n-api.service[65275]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 28 00:34:57 user devstack@n-api.service[65275]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Nov 28 00:34:57 2023] *** Nov 28 00:34:57 user devstack@n-api.service[65275]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Nov 28 00:34:57 user devstack@n-api.service[65275]: os: Linux-5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 Nov 28 00:34:57 user devstack@n-api.service[65275]: nodename: user Nov 28 00:34:57 user devstack@n-api.service[65275]: machine: x86_64 Nov 28 00:34:57 user devstack@n-api.service[65275]: clock source: unix Nov 28 00:34:57 user devstack@n-api.service[65275]: pcre jit disabled Nov 28 00:34:57 user devstack@n-api.service[65275]: detected number of CPU cores: 12 Nov 28 00:34:57 user devstack@n-api.service[65275]: current working directory: / Nov 28 00:34:57 user devstack@n-api.service[65275]: detected binary path: /usr/bin/uwsgi-core Nov 28 00:34:57 user devstack@n-api.service[65275]: your processes number limit is 63589 Nov 28 00:34:57 user devstack@n-api.service[65275]: your memory page size is 4096 bytes Nov 28 00:34:57 user devstack@n-api.service[65275]: detected max file descriptor number: 2048 Nov 28 00:34:57 user devstack@n-api.service[65275]: lock engine: pthread robust mutexes Nov 28 00:34:57 user devstack@n-api.service[65275]: thunder lock: enabled Nov 28 00:34:57 user devstack@n-api.service[65275]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 28 00:34:57 user devstack@n-api.service[65275]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] Nov 28 00:34:57 user devstack@n-api.service[65275]: PEP 405 virtualenv detected: /opt/stack/data/venv Nov 28 00:34:57 user devstack@n-api.service[65275]: Set PythonHome to /opt/stack/data/venv Nov 28 00:34:57 user devstack@n-api.service[65275]: Python main interpreter initialized at 0x55572b1b8b90 Nov 28 00:34:57 user devstack@n-api.service[65275]: python threads support enabled Nov 28 00:34:57 user devstack@n-api.service[65275]: your server socket listen backlog is limited to 100 connections Nov 28 00:34:57 user devstack@n-api.service[65275]: your mercy for graceful operations on workers is 80 seconds Nov 28 00:34:57 user devstack@n-api.service[65275]: mapped 537436 bytes (524 KB) for 3 cores Nov 28 00:34:57 user devstack@n-api.service[65275]: *** Operational MODE: preforking *** Nov 28 00:34:57 user devstack@n-api.service[65275]: *** uWSGI is running in multiple interpreter mode *** Nov 28 00:34:57 user devstack@n-api.service[65275]: spawned uWSGI master process (pid: 65275) Nov 28 00:34:57 user devstack@n-api.service[65275]: spawned uWSGI worker 1 (pid: 65276, cores: 1) Nov 28 00:34:57 user devstack@n-api.service[65275]: spawned uWSGI worker 2 (pid: 65277, cores: 1) Nov 28 00:34:57 user devstack@n-api.service[65275]: spawned uWSGI worker 3 (pid: 65278, cores: 1) Nov 28 00:34:57 user devstack@n-api.service[65275]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 00:35:01 user devstack@n-api.service[65276]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 00:35:01 user devstack@n-api.service[65276]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 00:35:01 user devstack@n-api.service[65276]: and ``live_migration_inbound_addr`` respectively. Nov 28 00:35:01 user devstack@n-api.service[65276]: ). Its value may be silently ignored in the future. Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 00:35:01 user devstack@n-api.service[65278]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 00:35:01 user devstack@n-api.service[65278]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 00:35:01 user devstack@n-api.service[65278]: and ``live_migration_inbound_addr`` respectively. Nov 28 00:35:01 user devstack@n-api.service[65278]: ). Its value may be silently ignored in the future. Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 00:35:01 user devstack@n-api.service[65277]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 00:35:01 user devstack@n-api.service[65277]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 00:35:01 user devstack@n-api.service[65277]: and ``live_migration_inbound_addr`` respectively. Nov 28 00:35:01 user devstack@n-api.service[65277]: ). Its value may be silently ignored in the future. Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65276) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65277) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 00:35:01 user devstack@n-api.service[65276]: INFO dbcounter [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Registered counter for database nova_api Nov 28 00:35:01 user devstack@n-api.service[65278]: INFO dbcounter [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Registered counter for database nova_api Nov 28 00:35:01 user devstack@n-api.service[65277]: INFO dbcounter [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Registered counter for database nova_api Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_db.sqlalchemy.engines [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_db.sqlalchemy.engines [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_db.sqlalchemy.engines [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65277) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writer thread running {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writer thread running {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writer thread running {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG nova.context [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3099e656-1610-4c42-b3b1-20ed37c4bef8(cell1) {{(pid=65276) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG nova.context [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3099e656-1610-4c42-b3b1-20ed37c4bef8(cell1) {{(pid=65278) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG nova.context [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3099e656-1610-4c42-b3b1-20ed37c4bef8(cell1) {{(pid=65277) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:35:01 user devstack@n-api.service[65276]: INFO dbcounter [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Registered counter for database nova_cell0 Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:35:01 user devstack@n-api.service[65278]: INFO dbcounter [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Registered counter for database nova_cell0 Nov 28 00:35:01 user devstack@n-api.service[65277]: INFO dbcounter [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Registered counter for database nova_cell0 Nov 28 00:35:01 user devstack@n-api.service[65276]: INFO dbcounter [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Registered counter for database nova_cell1 Nov 28 00:35:01 user devstack@n-api.service[65278]: INFO dbcounter [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Registered counter for database nova_cell1 Nov 28 00:35:01 user devstack@n-api.service[65277]: INFO dbcounter [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Registered counter for database nova_cell1 Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_db.sqlalchemy.engines [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writer thread running {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_db.sqlalchemy.engines [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65277) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writer thread running {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_db.sqlalchemy.engines [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writer thread running {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_db.sqlalchemy.engines [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_db.sqlalchemy.engines [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_db.sqlalchemy.engines [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65277) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writer thread running {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writer thread running {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65277]: INFO dbcounter [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Registered counter for database nova_cell0 Nov 28 00:35:01 user devstack@n-api.service[65276]: INFO dbcounter [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Registered counter for database nova_cell0 Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG oslo_db.sqlalchemy.engines [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65277) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writer thread running {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writer thread running {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG oslo_db.sqlalchemy.engines [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65276) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writer thread running {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65278]: INFO dbcounter [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Registered counter for database nova_cell0 Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG oslo_db.sqlalchemy.engines [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 00:35:01 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writer thread running {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 00:35:01 user devstack@n-api.service[65277]: WARNING keystonemiddleware.auth_token [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 00:35:01 user devstack@n-api.service[65277]: WARNING keystonemiddleware.auth_token [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 00:35:01 user devstack@n-api.service[65276]: WARNING keystonemiddleware.auth_token [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 00:35:01 user devstack@n-api.service[65278]: WARNING keystonemiddleware.auth_token [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 00:35:01 user devstack@n-api.service[65276]: WARNING keystonemiddleware.auth_token [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 00:35:01 user devstack@n-api.service[65278]: WARNING keystonemiddleware.auth_token [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 00:35:02 user devstack@n-api.service[65277]: WARNING keystonemiddleware.auth_token [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 00:35:02 user devstack@n-api.service[65277]: WARNING keystonemiddleware.auth_token [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 00:35:02 user devstack@n-api.service[65277]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55572b1b8b90 pid: 65277 (default app) Nov 28 00:35:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:35:02 user devstack@n-api.service[65276]: WARNING keystonemiddleware.auth_token [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 00:35:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001559 Nov 28 00:35:02 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Nov 28 00:35:02 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:35:02 user devstack@n-api.service[65276]: WARNING keystonemiddleware.auth_token [None req-9ab4ec84-2f4f-40ff-ada9-64bfe3175ead None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 00:35:02 user devstack@n-api.service[65278]: WARNING keystonemiddleware.auth_token [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 00:35:02 user devstack@n-api.service[65276]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55572b1b8b90 pid: 65276 (default app) Nov 28 00:35:02 user devstack@n-api.service[65278]: WARNING keystonemiddleware.auth_token [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 00:35:02 user devstack@n-api.service[65278]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55572b1b8b90 pid: 65278 (default app) Nov 28 00:37:11 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:11 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0599b3e8-a1f3-4996-81eb-ac7fcad43c7b None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001642 Nov 28 00:37:11 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:11 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:11 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:11 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:11 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:11 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-862eb8a0-e322-48a8-b9bc-9bd6ece22786 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-862eb8a0-e322-48a8-b9bc-9bd6ece22786 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.378855 Nov 28 00:37:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 28 00:37:11 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001918 Nov 28 00:37:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:14 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-df5367a9-30d5-426a-969a-d6b3d1a7a4e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-df5367a9-30d5-426a-969a-d6b3d1a7a4e8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406715 Nov 28 00:37:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:14 2023] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:14 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-74f34083-4f90-4f7d-88b5-c14179145380 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-74f34083-4f90-4f7d-88b5-c14179145380 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047488 Nov 28 00:37:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 00:37:14 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001261 Nov 28 00:37:16 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-58114868-9ebc-4abf-80bc-92198f02ee6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-58114868-9ebc-4abf-80bc-92198f02ee6b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067198 Nov 28 00:37:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:16 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-6177a515-bf9f-4b40-afc6-f203eb409994 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-6177a515-bf9f-4b40-afc6-f203eb409994 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039470 Nov 28 00:37:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 00:37:16 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001222 Nov 28 00:37:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-40618763-21a4-42d8-87e9-f7b5579f6ca0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "ram": 1024}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-40618763-21a4-42d8-87e9-f7b5579f6ca0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064734 Nov 28 00:37:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:18 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-48abf747-ae58-4a56-9a46-b649e6fa3762 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-48abf747-ae58-4a56-9a46-b649e6fa3762 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133659 Nov 28 00:37:18 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 00:37:18 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:20 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001310 Nov 28 00:37:20 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ea068a13-b0d9-4cb0-8c15-f801effb7931 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ea068a13-b0d9-4cb0-8c15-f801effb7931 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063222 Nov 28 00:37:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:20 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:20 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-783866df-f85b-4d93-a932-f171f427cec8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-783866df-f85b-4d93-a932-f171f427cec8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026993 Nov 28 00:37:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 00:37:20 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001394 Nov 28 00:37:22 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0c93c3ed-4ed0-468f-87a8-8119632b97c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0c93c3ed-4ed0-468f-87a8-8119632b97c8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060249 Nov 28 00:37:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:22 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026990 Nov 28 00:37:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 00:37:22 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fa8a820b-80ea-474e-9f47-27f1040ff153 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001386 Nov 28 00:37:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ef2e622f-008d-4b99-b81b-4c10d28b744a admin admin] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ef2e622f-008d-4b99-b81b-4c10d28b744a admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.079680 Nov 28 00:37:24 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 28 00:37:24 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:37:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001764 Nov 28 00:37:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:26 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:26 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:26 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:26 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:26 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:37:26 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-2e5e0c16-4525-4067-8b86-a2a2edf896ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:27 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-2e5e0c16-4525-4067-8b86-a2a2edf896ac admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.384471 Nov 28 00:37:27 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:26 2023] POST /compute/v2.1/flavors => generated 400 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e169633c-470a-432b-89a6-a6af2452308d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e169633c-470a-432b-89a6-a6af2452308d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036097 Nov 28 00:37:27 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 00:37:27 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:29 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:29 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002587 Nov 28 00:37:29 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:29 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:29 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9c47729a-9bb9-46fa-a399-05e922117b51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-9c47729a-9bb9-46fa-a399-05e922117b51 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.112028 Nov 28 00:37:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:29 2023] POST /compute/v2.1/flavors => generated 403 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-57411d55-bc3f-4687-a8c0-14889bd1ff9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-57411d55-bc3f-4687-a8c0-14889bd1ff9d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039743 Nov 28 00:37:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 00:37:29 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001544 Nov 28 00:37:31 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ceff59bb-8012-40a2-8e51-e3bb60c70ad0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "disk": 40}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:31 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ceff59bb-8012-40a2-8e51-e3bb60c70ad0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085653 Nov 28 00:37:31 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:31 2023] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:31 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-207b10a8-18a8-4a5a-a393-8b2f88e676cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:31 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-207b10a8-18a8-4a5a-a393-8b2f88e676cd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028182 Nov 28 00:37:31 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 00:37:31 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:33 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001703 Nov 28 00:37:33 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:33 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7f0aa559-4680-4db1-8e3d-c5795118be76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "vcpus": 4, "ram": 8192}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7f0aa559-4680-4db1-8e3d-c5795118be76 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.074347 Nov 28 00:37:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:33 2023] POST /compute/v2.1/flavors => generated 403 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4c4fca78-c3d3-4069-bbd9-6066a80d23ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4c4fca78-c3d3-4069-bbd9-6066a80d23ef admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024307 Nov 28 00:37:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 00:37:33 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:37:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:37:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002204 Nov 28 00:37:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 00:37:35 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:37:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f46398a5-8832-4bf7-a64b-8c0bec6a2c78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f46398a5-8832-4bf7-a64b-8c0bec6a2c78 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072384 Nov 28 00:37:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 00:37:35 2023] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:37:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d732b5a4-4640-4397-b550-11c0508a594d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:37:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d732b5a4-4640-4397-b550-11c0508a594d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025597 Nov 28 00:37:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 00:37:35 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:38:07 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:38:07 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-da2c6294-2887-4266-8e00-446c55051b53 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001611 Nov 28 00:38:07 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 00:38:07 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:38:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:38:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:38:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:38:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:38:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:38:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:38:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:38:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:38:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.099735 Nov 28 00:38:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1389 bytes} [Tue Nov 28 00:38:07 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:38:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d732b5a4-4640-4397-b550-11c0508a594d admin admin] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:38:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d732b5a4-4640-4397-b550-11c0508a594d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002004 Nov 28 00:38:37 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 00:38:37 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:38:37 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:38:37 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e35a6cad-9069-4e36-bb47-62cfc88ca058 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:38:37 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e35a6cad-9069-4e36-bb47-62cfc88ca058 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.069838 Nov 28 00:38:37 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1368 bytes} [Tue Nov 28 00:38:37 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:38:40 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:38:40 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7449b8a5-adfb-40e9-8f68-688241ebc263 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002315 Nov 28 00:38:40 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 00:38:40 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:38:40 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:38:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b7c8709c-2e74-4dc3-95d9-954870274239 admin admin] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:38:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-b7c8709c-2e74-4dc3-95d9-954870274239 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 424 microversion: 2.61 time: 0.069521 Nov 28 00:38:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 15/41] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 28 00:38:40 2023] GET /compute/v2.1/flavors/1 => generated 424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:38:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e35a6cad-9069-4e36-bb47-62cfc88ca058 admin admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:38:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e35a6cad-9069-4e36-bb47-62cfc88ca058 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001789 Nov 28 00:38:42 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 14/42] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 00:38:42 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:38:42 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:38:42 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:38:42 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:38:42 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4f70221b-cad7-4395-8ea8-faab4c4b5eb7 admin admin] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:38:42 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-4f70221b-cad7-4395-8ea8-faab4c4b5eb7 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/2" status: 200 len: 427 microversion: 2.61 time: 0.071289 Nov 28 00:38:42 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 14/43] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 28 00:38:42 2023] GET /compute/v2.1/flavors/2 => generated 427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:41:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:15 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-00eb6968-6252-48b5-9ea2-da7ebc7b3c96 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'create', calling method: .version_select at 0x7f49742bab00>, body: {"keypair": {"name": "tempest-keypair-818574112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBojOTsicQTPQwVQo4L8uyvLpM8AzzdIo8hG3nN7wDoXV5G0WKxa2YoDIlh+1MayTyVng267NLROE5xB7OrrrwLQDoCo8FR61dl8a3nYIWGdFPbxh/G7hPGvgBPD65Gpg=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:15 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-00eb6968-6252-48b5-9ea2-da7ebc7b3c96 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting quotas for project 7cf38cc0048d41bfb69a50d55f9c1963. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:15 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-00eb6968-6252-48b5-9ea2-da7ebc7b3c96 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting quotas for user 7cf2b106f48442cd84784a5880737464 and project 7cf38cc0048d41bfb69a50d55f9c1963. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:15 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-00eb6968-6252-48b5-9ea2-da7ebc7b3c96 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.384197 Nov 28 00:41:15 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 16/44] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:41:14 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:17 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-bc529c13-b9b9-497a-bf74-74c2ab810e4f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'create', calling method: .version_select at 0x7f4974276d40>, body: {"keypair": {"name": "tempest-keypair-1133257069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Gelp4Gx9SsSLq+xZi0yjB5FcZdjT+TgCL2GO3Pf5JN15qaGivyqqJzLgKEPRJBZVARdsvMlh6Eevtq42CkVHhqrvb46VhxvyTePE2kP5apul9kmi2CxBRMQ1LI+8itA=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:17 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-bc529c13-b9b9-497a-bf74-74c2ab810e4f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:17 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-bc529c13-b9b9-497a-bf74-74c2ab810e4f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for user f63a0e9261934c8b8e673f069c3376bd and project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-bc529c13-b9b9-497a-bf74-74c2ab810e4f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.426945 Nov 28 00:41:17 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 15/45] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:41:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:20 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:20 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1318610697", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "7548b01b-c93b-4351-a955-67633111ec0c"}], "security_groups": [{"name": "tempest-securitygroup--1221870366"}], "key_name": "tempest-keypair-818574112", "user_data": "}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:21 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] validate_networks() for [('7548b01b-c93b-4351-a955-67633111ec0c', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:21 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-368791726", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:21 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-963073311", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:21 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] validate_networks() for [('482f09e3-29f6-48fd-8552-3303e851daac', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:22 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] validate_networks() for [('0ce73ad0-6ff4-422c-91dd-e52e37370fe1', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting quotas for project 7cf38cc0048d41bfb69a50d55f9c1963. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting quotas for user 7cf2b106f48442cd84784a5880737464 and project 7cf38cc0048d41bfb69a50d55f9c1963. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c4c05fd9-da54-49ad-9984-4cc2ac33a267 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.799628 Nov 28 00:41:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:41:20 2023] POST /compute/v2.1/servers => generated 400 bytes in 2801 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4b0c1013-6564-403d-a318-6fc8e0d64fd1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4b0c1013-6564-403d-a318-6fc8e0d64fd1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting quotas for project 4e8c7ba7df64471b83fbfb45237c8ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting quotas for user aad5a4c6583f42b39eda624923ded77b and project 4e8c7ba7df64471b83fbfb45237c8ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-4b0c1013-6564-403d-a318-6fc8e0d64fd1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-4b0c1013-6564-403d-a318-6fc8e0d64fd1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1229 microversion: 2.1 time: 0.326787 Nov 28 00:41:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 16/47] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:41:23 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1229 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:41:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7e8f2df1-86a3-4a26-817c-7a4b9fb0dc61 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.443341 Nov 28 00:41:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 17/48] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:41:21 2023] POST /compute/v2.1/servers => generated 381 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d5c797a3-f21b-4bdc-9c82-8e0fe0e9eaaa tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-d5c797a3-f21b-4bdc-9c82-8e0fe0e9eaaa tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:23 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-d5c797a3-f21b-4bdc-9c82-8e0fe0e9eaaa tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-d5c797a3-f21b-4bdc-9c82-8e0fe0e9eaaa tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 200 len: 1213 microversion: 2.1 time: 0.114741 Nov 28 00:41:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 17/49] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:41:23 2023] GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting quotas for project 576886774b2943b999ec92134d8065b4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting quotas for user 8aa0d095400943e28234a9f476ea0a4f and project 576886774b2943b999ec92134d8065b4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:23 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1646530713", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0ed03409-2d66-4334-86c1-d6f603285b0f tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.503809 Nov 28 00:41:24 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 16/50] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 00:41:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:41:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-398d847b-c1b5-4902-8b0c-e742183c04db tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:24 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-398d847b-c1b5-4902-8b0c-e742183c04db tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:24 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-1516510796", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "1fef710f-91b8-46ea-a616-1a2c3c3ff203"}], "security_groups": [{"name": "tempest-securitygroup--565879118"}], "key_name": "tempest-keypair-1133257069", "user_data": "}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] validate_networks() for [('482f09e3-29f6-48fd-8552-3303e851daac', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:24 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-398d847b-c1b5-4902-8b0c-e742183c04db tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:24 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-398d847b-c1b5-4902-8b0c-e742183c04db tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:24 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-398d847b-c1b5-4902-8b0c-e742183c04db tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-398d847b-c1b5-4902-8b0c-e742183c04db tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079" status: 200 len: 1394 microversion: 2.87 time: 0.181392 Nov 28 00:41:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 18/51] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:41:24 2023] GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079 => generated 1394 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:41:24 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] validate_networks() for [('1fef710f-91b8-46ea-a616-1a2c3c3ff203', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting quotas for project 4e8c7ba7df64471b83fbfb45237c8ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting quotas for user aad5a4c6583f42b39eda624923ded77b and project 4e8c7ba7df64471b83fbfb45237c8ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:24 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-cb96d2ab-58d8-4eda-87ba-2147fb57520a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.027920 Nov 28 00:41:25 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 18/52] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:41:23 2023] POST /compute/v2.1/servers => generated 381 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:41:25 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f7f34221-e52a-47d2-b18d-80b5151f0eab tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:25 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f7f34221-e52a-47d2-b18d-80b5151f0eab tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:25 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-f7f34221-e52a-47d2-b18d-80b5151f0eab tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f7f34221-e52a-47d2-b18d-80b5151f0eab tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f" status: 200 len: 1214 microversion: 2.1 time: 0.435261 Nov 28 00:41:25 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:41:25 2023] GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f => generated 1214 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for user f63a0e9261934c8b8e673f069c3376bd and project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:26 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-4af98680-c360-4829-9ec6-7530587cd30b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.333624 Nov 28 00:41:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 17/54] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:41:24 2023] POST /compute/v2.1/servers => generated 406 bytes in 2338 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 28 00:41:26 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0fa8bdbe-2214-4246-9495-e61d5e0f978e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:26 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0fa8bdbe-2214-4246-9495-e61d5e0f978e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:26 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0fa8bdbe-2214-4246-9495-e61d5e0f978e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0fa8bdbe-2214-4246-9495-e61d5e0f978e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1233 microversion: 2.1 time: 0.176578 Nov 28 00:41:26 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 19/55] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:41:26 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1233 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Creating event network-changed:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a5486ce5-bb5b-4b4d-9545-7f00b27e3a5e req-4cc91855-1f77-4c1d-8cd4-f164f2f2529a service nova] Acquired lock "compute-rpcapi-router" {{(pid=65278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:32 user devstack@n-api.service[65278]: INFO nova.compute.rpcapi [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 00:41:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] Releasing lock "compute-rpcapi-router" {{(pid=65278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 00:41:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-765bd840-3073-47cb-89dc-be0179e22da0 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167542 Nov 28 00:41:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 20/56] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19151248-a33d-46b2-be99-0a85a5ab88d3", "tag": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Creating event network-changed:e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance 19151248-a33d-46b2-be99-0a85a5ab88d3 on user Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e0c68ec0-2530-4625-a056-9910c5845993 req-25120840-8e43-4bca-a58a-7ebc90c1dead service nova] Acquired lock "compute-rpcapi-router" {{(pid=65276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:34 user devstack@n-api.service[65276]: INFO nova.compute.rpcapi [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 00:41:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] Releasing lock "compute-rpcapi-router" {{(pid=65276) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 00:41:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0fab403c-0234-4e4d-8f7e-f6639137ed23 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189995 Nov 28 00:41:34 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 18/57] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Creating event network-changed:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65277) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-db37f182-f494-4e0b-9dad-64513128500e req-57a1f7ce-cefd-40d4-99c7-e10818b018a0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=65277) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:34 user devstack@n-api.service[65277]: INFO nova.compute.rpcapi [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 00:41:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] Releasing lock "compute-rpcapi-router" {{(pid=65277) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 00:41:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-bc30605e-e461-40df-830d-6b1ae4048525 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138761 Nov 28 00:41:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 20/58] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}, {"name": "network-changed", "server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Creating event network-changed:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:41:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] Creating event network-changed:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 00:41:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-52f53908-c7f7-4c1c-82be-8db98b73cbd6 req-e9a0ef85-d82f-4296-ab46-796fdcd36028 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034609 Nov 28 00:41:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 21/59] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:34 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:37 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=16 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:37 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-cca9835c-c634-4d72-8c02-3221e44ca2f5 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Action: 'create', calling method: .version_select at 0x7f4974031d80>, body: {"keypair": {"name": "tempest-keypair-2094337696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmhSe4yt2zgpFuLSEaBNMFCfQEO+QSmraG+pYRtdpblrmCGO6mV7MPaD+lQDdSMsHI6o6aUzPYUDsWwGXKodtKN0zw3FGkAKn1th/bUwX4t22USh80iUUJSHJ67JruAZA=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:37 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-cca9835c-c634-4d72-8c02-3221e44ca2f5 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting quotas for project ea1afcbb4b3643c5ae366c8e39f3d8ed. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:37 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-cca9835c-c634-4d72-8c02-3221e44ca2f5 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting quotas for user 6657488fa71b469c954276af7717308e and project ea1afcbb4b3643c5ae366c8e39f3d8ed. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:37 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-cca9835c-c634-4d72-8c02-3221e44ca2f5 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.233717 Nov 28 00:41:37 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 19/60] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:41:37 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:39 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=18 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:39 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1834749863", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "5e24bcbb-fe85-4019-a107-ea0b5809297e"}], "security_groups": [{"name": "tempest-securitygroup--1617858833"}], "key_name": "tempest-keypair-2094337696", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:39 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] validate_networks() for [('5e24bcbb-fe85-4019-a107-ea0b5809297e', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting quotas for project ea1afcbb4b3643c5ae366c8e39f3d8ed. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting quotas for user 6657488fa71b469c954276af7717308e and project ea1afcbb4b3643c5ae366c8e39f3d8ed. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:40 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ef292f57-0be3-4689-8ef9-9fcc798b59da tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.808748 Nov 28 00:41:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 21/61] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:41:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:41:40 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=14 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:40 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-95249f6d-cd09-4f30-bca2-0a998b4ba3ec tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:40 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-95249f6d-cd09-4f30-bca2-0a998b4ba3ec tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:40 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-95249f6d-cd09-4f30-bca2-0a998b4ba3ec tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6657488fa71b469c954276af7717308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1afcbb4b3643c5ae366c8e39f3d8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:40 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-95249f6d-cd09-4f30-bca2-0a998b4ba3ec tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a" status: 200 len: 1234 microversion: 2.1 time: 0.155625 Nov 28 00:41:40 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:41:40 2023] GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a => generated 1234 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:41:44 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:44 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:44 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-45609468-16ca-44df-b996-ad030b1e4f95 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Action: 'create', calling method: .version_select at 0x7f4974bd9cf0>, body: {"keypair": {"name": "tempest-keypair-1026390778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwnHKx+PiTEI0wUrFbf6lAcmNgFJf1sB96KFPtN1nsQLvuUpSP+zMzvsEQu60Iu8aCR66g+RaiF1f/PKfGhvzPotEZvGPkQ6i3IIL05YARIE+yLueZIgKDKP+kerp2PnA=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:44 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-45609468-16ca-44df-b996-ad030b1e4f95 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Getting quotas for project 616d5666496446ce828fde8a3dd0380b. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:44 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-45609468-16ca-44df-b996-ad030b1e4f95 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Getting quotas for user 36df2251d9194760adcbdb9bf70ba341 and project 616d5666496446ce828fde8a3dd0380b. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-45609468-16ca-44df-b996-ad030b1e4f95 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.396463 Nov 28 00:41:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 20/63] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:41:44 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ddc43886-9e22-4537-bfb2-d5855b2c40bd tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Action: 'create', calling method: .version_select at 0x7f49740f2ef0>, body: {"keypair": {"name": "tempest-keypair-1061836304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4QeL15P6c9utIauWrNdx/6cekCFpBcDxaGPTCFy2yAv3SlndlrZ4cTVtjGvwCTEh+nVTyCgLcMVAdGm9KxhdSbHwbD3eHurymDgO/KEGJjlpcHuQf3C9qojMGA4fCAg=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:44 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-ddc43886-9e22-4537-bfb2-d5855b2c40bd tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Getting quotas for project 9b41d15ebfac4bb8aa32e310b2b2adee. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:44 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-ddc43886-9e22-4537-bfb2-d5855b2c40bd tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Getting quotas for user 4fa42e3664c64c9696a0bbd62853c291 and project 9b41d15ebfac4bb8aa32e310b2b2adee. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ddc43886-9e22-4537-bfb2-d5855b2c40bd tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.057899 Nov 28 00:41:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 22/64] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 00:41:44 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 28 00:41:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c97e85ed-42f5-4b6a-a1db-7e8ea03471e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Action: 'create', calling method: .version_select at 0x7f49740dc670>, body: {"keypair": {"name": "tempest-keypair-7931677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI8v8L4f2bUuyj5OhUmhozUp13Ks3fEXRi3Oj6qTZkdAZBJ96CVn6kUw9HpfFZZCCphg/vMW3teFNC6XQPhuvhYhd7IKUXYFQ+6Z9SU6vXSbWsXURJpVx1JUUK/fwm46Q=="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:46 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:46 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:41:46 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-c97e85ed-42f5-4b6a-a1db-7e8ea03471e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Getting quotas for project bfcf25cb4d7643beaf41d08d65c37c76. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:46 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-c97e85ed-42f5-4b6a-a1db-7e8ea03471e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Getting quotas for user 4107c4de40db41478617a3e7740cdaf2 and project bfcf25cb4d7643beaf41d08d65c37c76. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c97e85ed-42f5-4b6a-a1db-7e8ea03471e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.106921 Nov 28 00:41:46 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 23/65] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:41:46 2023] POST /compute/v2.1/os-keypairs => generated 383 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:41:48 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-848238653", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "7139c69b-63ec-4a2d-8d3d-d7ed611dbe56"}], "security_groups": [{"name": "tempest-securitygroup--1213363425"}], "key_name": "tempest-keypair-1061836304", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:48 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] validate_networks() for [('7139c69b-63ec-4a2d-8d3d-d7ed611dbe56', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:49 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-293684211", "imageRef": "6e30adb9-4060-4751-85b1-4631c7e5b7c4", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "ec740256-41a3-4468-b79d-dd22c2713d36"}], "security_groups": [{"name": "tempest-securitygroup--2097773305"}], "key_name": "tempest-keypair-1026390778", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:49 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] validate_networks() for [('ec740256-41a3-4468-b79d-dd22c2713d36', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Getting quotas for project 616d5666496446ce828fde8a3dd0380b. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Getting quotas for user 36df2251d9194760adcbdb9bf70ba341 and project 616d5666496446ce828fde8a3dd0380b. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e30adb9-4060-4751-85b1-4631c7e5b7c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:50 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4012caac-42bf-41ee-bacb-23fbb93357be tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.248916 Nov 28 00:41:50 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 23/66] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:41:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:41:50 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-caf4e3c8-ca80-460a-89e5-087b32140b48 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:50 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-caf4e3c8-ca80-460a-89e5-087b32140b48 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Getting quotas for project 9b41d15ebfac4bb8aa32e310b2b2adee. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Getting quotas for user 4fa42e3664c64c9696a0bbd62853c291 and project 9b41d15ebfac4bb8aa32e310b2b2adee. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:50 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-caf4e3c8-ca80-460a-89e5-087b32140b48 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36df2251d9194760adcbdb9bf70ba341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616d5666496446ce828fde8a3dd0380b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:50 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-caf4e3c8-ca80-460a-89e5-087b32140b48 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e" status: 200 len: 1237 microversion: 2.1 time: 0.200049 Nov 28 00:41:50 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 24/67] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:41:50 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e => generated 1237 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:41:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-308329c4-2b09-490d-96cb-2750b1aa7312 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 2.522070 Nov 28 00:41:50 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 21/68] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 00:41:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4cc19088-f2fe-4844-914e-6a3762f861b0 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4cc19088-f2fe-4844-914e-6a3762f861b0 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4cc19088-f2fe-4844-914e-6a3762f861b0 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:50 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-255438338", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "a7880cfb-ac6f-473a-95b4-3f450cdae98d"}], "security_groups": [{"name": "tempest-securitygroup--512724572"}], "key_name": "tempest-keypair-7931677", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4cc19088-f2fe-4844-914e-6a3762f861b0 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:50 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4cc19088-f2fe-4844-914e-6a3762f861b0 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:50 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4cc19088-f2fe-4844-914e-6a3762f861b0 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15" status: 200 len: 1320 microversion: 2.49 time: 0.177883 Nov 28 00:41:50 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 24/69] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:41:50 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15 => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f443cac-7a1c-49d2-9ed1-79a13883688a", "tag": "7b8ba726-9082-4459-86ba-f4317c342dbe"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] Creating event network-changed:7b8ba726-9082-4459-86ba-f4317c342dbe for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a on user Nov 28 00:41:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-310e333b-bd28-4ccc-a6e4-c2b5e881aa36 req-a0cf108e-fa62-4bdb-ab6a-693050c4c6b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124091 Nov 28 00:41:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 22/70] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:51 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] validate_networks() for [('a7880cfb-ac6f-473a-95b4-3f450cdae98d', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Getting quotas for project bfcf25cb4d7643beaf41d08d65c37c76. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Getting quotas for user 4107c4de40db41478617a3e7740cdaf2 and project bfcf25cb4d7643beaf41d08d65c37c76. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:41:52 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:41:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5fd2e7c3-e4b2-4bba-b93e-9366d8d1844b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.158070 Nov 28 00:41:52 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 25/71] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:41:50 2023] POST /compute/v2.1/servers => generated 403 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 28 00:41:52 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cfa251d8-340a-4eec-a62b-3bc558636480 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:41:52 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cfa251d8-340a-4eec-a62b-3bc558636480 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:41:53 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-cfa251d8-340a-4eec-a62b-3bc558636480 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4107c4de40db41478617a3e7740cdaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcf25cb4d7643beaf41d08d65c37c76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:41:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-cfa251d8-340a-4eec-a62b-3bc558636480 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24" status: 200 len: 1220 microversion: 2.1 time: 0.228872 Nov 28 00:41:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 25/72] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:41:52 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24 => generated 1220 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:41:55 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f443cac-7a1c-49d2-9ed1-79a13883688a", "name": "network-vif-plugged", "status": "completed", "tag": "7b8ba726-9082-4459-86ba-f4317c342dbe"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:55 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] Creating event network-vif-plugged:7b8ba726-9082-4459-86ba-f4317c342dbe for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a on user Nov 28 00:41:55 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-8082af81-62b2-4b38-b79c-70f7660dec0c req-885bc3cd-1a57-47d9-bc15-7595d1e7c00a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093382 Nov 28 00:41:55 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 23/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:55 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e6493420-6640-478c-9b0c-ce21a2eb7115 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Action: 'create', calling method: .version_select at 0x7f497371dcf0>, body: {"keypair": {"name": "tempest-keypair-120630317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvTiY4dxQAb9LsYRO0lskk9ck/WkedyunqgTAhqwxwkQxob6pmFUtvNK0PLIropmLdelwefawXtUbFkAj07J8tGnQxdvzeSVHovmSM6IobjeCc2WsqnQKXobXN3gL+AtQ=="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:55 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-e6493420-6640-478c-9b0c-ce21a2eb7115 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Getting quotas for project 47ed4d4553b4460ca8688714e6d7c335. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:41:55 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-e6493420-6640-478c-9b0c-ce21a2eb7115 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Getting quotas for user 764878c5fd98438193043f4a5e812442 and project 47ed4d4553b4460ca8688714e6d7c335. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:41:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e6493420-6640-478c-9b0c-ce21a2eb7115 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.330842 Nov 28 00:41:55 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 26/74] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:41:55 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:56 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8080c31-0df3-44ba-8586-b1ca39d9c97e", "tag": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] Creating event network-changed:f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e on user Nov 28 00:41:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-2a03d60e-b5be-4fc9-bcfd-47c772c3e475 req-37ccd62d-3398-442b-96b7-869c3a29e6d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069959 Nov 28 00:41:56 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:57 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f443cac-7a1c-49d2-9ed1-79a13883688a", "name": "network-vif-plugged", "status": "completed", "tag": "7b8ba726-9082-4459-86ba-f4317c342dbe"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:57 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] Creating event network-vif-plugged:7b8ba726-9082-4459-86ba-f4317c342dbe for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a on user Nov 28 00:41:57 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-76b28f39-b54e-4822-afb0-d9bbb22d5353 req-5c922c36-479d-41dc-8208-0d305b2338e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097882 Nov 28 00:41:57 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 24/76] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:58 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86575409-89de-4408-a573-d069767ebb15", "tag": "734679ea-803f-454c-ad23-ed3bbd4951e5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:58 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] Creating event network-changed:734679ea-803f-454c-ad23-ed3bbd4951e5 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:41:58 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-8b73c3b9-0aee-4a84-8a7a-fffa805aab00 req-b4c6db88-ee44-4047-a7d2-26e7cf9d7963 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101693 Nov 28 00:41:58 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:41:59 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46fb5677-018f-4e32-b945-166600ec6a24", "tag": "d958f7e8-8730-4756-8515-ce61c1d1efce"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:41:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:41:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:41:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:41:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] Creating event network-changed:d958f7e8-8730-4756-8515-ce61c1d1efce for instance 46fb5677-018f-4e32-b945-166600ec6a24 on user Nov 28 00:41:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-ef8526ca-9c73-430e-b56a-0810c1d76a47 req-2ac22641-8385-4ea4-9588-4d39f8c65e9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050022 Nov 28 00:41:59 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:41:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAssistedSnapshotsTest-server-2042329240", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665"}], "security_groups": [{"name": "tempest-securitygroup--381442895"}], "key_name": "tempest-keypair-120630317", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=14 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:00 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] validate_networks() for [('54dbbe4e-bfd6-4f5e-8c6f-8b8de6125665', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Getting quotas for project 47ed4d4553b4460ca8688714e6d7c335. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Getting quotas for user 764878c5fd98438193043f4a5e812442 and project 47ed4d4553b4460ca8688714e6d7c335. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:42:01 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:42:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-59f20fe5-252b-43e2-a65a-ba7157acaca3 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.196590 Nov 28 00:42:01 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 25/79] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:42:00 2023] POST /compute/v2.1/servers => generated 403 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:42:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7dd8af8a-f008-4854-ae49-e5dd8f3c10a7 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-7dd8af8a-f008-4854-ae49-e5dd8f3c10a7 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:01 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-7dd8af8a-f008-4854-ae49-e5dd8f3c10a7 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764878c5fd98438193043f4a5e812442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ed4d4553b4460ca8688714e6d7c335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7dd8af8a-f008-4854-ae49-e5dd8f3c10a7 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9" status: 200 len: 1237 microversion: 2.1 time: 0.189645 Nov 28 00:42:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 28/80] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:42:01 2023] GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9 => generated 1237 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:42:04 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=10 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:04 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=20 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-plugged", "status": "completed", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] Creating event network-vif-plugged:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:42:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-79925cd0-2d31-4b71-97cb-15f6d4d9b077 req-7c6a221f-26e8-462c-9b82-34d58c8ee0f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256027 Nov 28 00:42:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdea5f7d-ce77-4c66-afac-ddc24baeabd9", "tag": "cd82c939-7f4c-4114-97c2-9a4f166d9e23"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] Creating event network-changed:cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 on user Nov 28 00:42:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-786b7d88-2a63-4bd0-a351-3b12f0e72961 req-99d6bf68-4def-4cc6-ae29-a8aedf2dd0f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092965 Nov 28 00:42:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 26/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:05 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:05 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19151248-a33d-46b2-be99-0a85a5ab88d3", "name": "network-vif-plugged", "status": "completed", "tag": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] Creating event network-vif-plugged:e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance 19151248-a33d-46b2-be99-0a85a5ab88d3 on user Nov 28 00:42:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4f05e426-c39f-43e5-b9e6-6aefbe47be24 req-c81f0656-5942-4453-a845-5d02717565ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059149 Nov 28 00:42:05 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 29/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:06 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-plugged", "status": "completed", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Creating event network-vif-plugged:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:42:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:42:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:42:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:42:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-c413e2ff-fc05-4001-b54d-3292876e8de5 req-49d6879a-2dc0-4d4a-8a3e-ed9e9499b6ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.048045 Nov 28 00:42:06 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:06 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:42:07 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-plugged", "status": "completed", "tag": "734679ea-803f-454c-ad23-ed3bbd4951e5"}, {"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-plugged", "status": "completed", "tag": "734679ea-803f-454c-ad23-ed3bbd4951e5"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:07 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:07 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:07 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:07 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Creating event network-vif-plugged:734679ea-803f-454c-ad23-ed3bbd4951e5 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:42:07 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] Creating event network-vif-plugged:734679ea-803f-454c-ad23-ed3bbd4951e5 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:42:07 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-7faf4657-6d0f-4438-b56a-be5687cc82eb req-d07b3dda-7fe8-436f-a31e-7c7c5f34a29a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068534 Nov 28 00:42:07 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 27/85] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:42:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19151248-a33d-46b2-be99-0a85a5ab88d3", "name": "network-vif-plugged", "status": "completed", "tag": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef"}, {"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-plugged", "status": "completed", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}, {"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-plugged", "status": "completed", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Creating event network-vif-plugged:e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance 19151248-a33d-46b2-be99-0a85a5ab88d3 on user Nov 28 00:42:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Creating event network-vif-plugged:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 00:42:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] Creating event network-vif-plugged:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 00:42:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-26f06454-9db0-4828-902f-1632992dca07 req-18f29f26-d475-4ed1-a3a7-64b70ec8dc5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048550 Nov 28 00:42:08 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:08 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:08 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}, {"server_uuid": "46fb5677-018f-4e32-b945-166600ec6a24", "name": "network-vif-plugged", "status": "completed", "tag": "d958f7e8-8730-4756-8515-ce61c1d1efce"}, {"server_uuid": "46fb5677-018f-4e32-b945-166600ec6a24", "name": "network-vif-plugged", "status": "completed", "tag": "d958f7e8-8730-4756-8515-ce61c1d1efce"}, {"server_uuid": "b8080c31-0df3-44ba-8586-b1ca39d9c97e", "name": "network-vif-plugged", "status": "completed", "tag": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c"}, {"server_uuid": "b8080c31-0df3-44ba-8586-b1ca39d9c97e", "name": "network-vif-plugged", "status": "completed", "tag": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:42:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Creating event network-vif-plugged:d958f7e8-8730-4756-8515-ce61c1d1efce for instance 46fb5677-018f-4e32-b945-166600ec6a24 on user Nov 28 00:42:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Creating event network-vif-plugged:d958f7e8-8730-4756-8515-ce61c1d1efce for instance 46fb5677-018f-4e32-b945-166600ec6a24 on user Nov 28 00:42:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Creating event network-vif-plugged:f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e on user Nov 28 00:42:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] Creating event network-vif-plugged:f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e on user Nov 28 00:42:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-4df495d1-30b0-40cb-a801-937b750acb4a req-9965193d-9c3e-471d-86ef-33d35c4b79d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.048218 Nov 28 00:42:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 30/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:08 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdea5f7d-ce77-4c66-afac-ddc24baeabd9", "name": "network-vif-plugged", "status": "completed", "tag": "cd82c939-7f4c-4114-97c2-9a4f166d9e23"}, {"server_uuid": "fdea5f7d-ce77-4c66-afac-ddc24baeabd9", "name": "network-vif-plugged", "status": "completed", "tag": "cd82c939-7f4c-4114-97c2-9a4f166d9e23"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Creating event network-vif-plugged:cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 on user Nov 28 00:42:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] Creating event network-vif-plugged:cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 on user Nov 28 00:42:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-b14f0106-4d90-452e-b6bc-c0fa7baa996a req-7e7f7b9a-5ba3-4c1b-a81d-265527614151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038888 Nov 28 00:42:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 28/88] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=20 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:14 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:14 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-633b6e76-95ea-475a-9a8c-cc193aff8ee6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1535 microversion: 2.1 time: 1.225909 Nov 28 00:42:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:42:13 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1535 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:42:15 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=24 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:16 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:16 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:16 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:16 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=105,nova_api:INSERT=14 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-40282aab-0faf-478d-a496-1801c5e1f917 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079" status: 200 len: 1689 microversion: 2.87 time: 1.920288 Nov 28 00:42:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 31/90] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:42:14 2023] GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079 => generated 1689 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:42:16 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-82a55141-3aa9-4676-b7fa-7ebe057faf36 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f" status: 200 len: 1502 microversion: 2.1 time: 1.047787 Nov 28 00:42:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 29/91] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:42:15 2023] GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f => generated 1502 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:42:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:16 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:17 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-170ef9eb-7503-4100-a451-bcf1ffb87387 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1541 microversion: 2.1 time: 0.433495 Nov 28 00:42:17 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 32/92] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:42:16 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1541 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:31 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6657488fa71b469c954276af7717308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1afcbb4b3643c5ae366c8e39f3d8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:31 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-08b75cc1-0380-47f7-adb5-f0d3620b8ab1 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a" status: 200 len: 1544 microversion: 2.1 time: 0.282686 Nov 28 00:42:31 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 32/93] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:42:30 2023] GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a => generated 1544 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:42:37 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-462fd7ea-93c5-42d0-9c28-840add088dbb tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Action: 'create', calling method: .version_select at 0x7f49742740d0>, body: {"keypair": {"name": "tempest-keypair-452999819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkC7YiVymRy0j2erWhVGdY5foqGZ/P4JKkXCABg/tvm1qAjeVS3/X1fCbah+VOFmazPyRoIQlbAezdqNzgsa4N/GuqPO3bJCqUk1EseNVjoiGLvVUCpKKM1ixmCfux2Sw=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:37 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=107,nova_api:INSERT=15 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:37 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=22 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:37 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-462fd7ea-93c5-42d0-9c28-840add088dbb tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Getting quotas for project 12a0f37585d44cc6a8f14651c74869c8. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:42:37 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-462fd7ea-93c5-42d0-9c28-840add088dbb tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Getting quotas for user c110bc80f8fa44f6863d2ebe961d2510 and project 12a0f37585d44cc6a8f14651c74869c8. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:42:37 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-462fd7ea-93c5-42d0-9c28-840add088dbb tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.054233 Nov 28 00:42:37 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 30/94] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 00:42:37 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 00:42:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-222609210", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "e9199b7a-6370-4897-b5f7-76cfd7236904"}, {"port": "03619394-6a6e-497d-b570-4a288cdcd6f7", "tag": "port-1"}, {"port": "12d80f85-36dc-495d-9e2a-47ccaeafe267", "tag": "port-2"}, {"uuid": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683", "tag": "net-1"}, {"uuid": "62e0d794-1ae9-4b26-8244-1d9b5a5e2683"}, {"uuid": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "dfba0188-78f7-4ef0-a411-0b8b98e093a6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "52865390-32c6-476c-b67a-61116319990f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6685b5b0-ebeb-4499-80de-9a81996811db", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2b6b19a4-9b37-451a-a517-92a140e6c9f4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--885766401"}], "key_name": "tempest-keypair-452999819", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:38 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:38 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=20 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:38 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] validate_networks() for [('e9199b7a-6370-4897-b5f7-76cfd7236904', None, None, None, None, None), (None, None, '03619394-6a6e-497d-b570-4a288cdcd6f7', None, None, None), (None, None, '12d80f85-36dc-495d-9e2a-47ccaeafe267', None, None, None), ('62e0d794-1ae9-4b26-8244-1d9b5a5e2683', None, None, None, None, None), ('62e0d794-1ae9-4b26-8244-1d9b5a5e2683', None, None, None, None, None), ('dfba0188-78f7-4ef0-a411-0b8b98e093a6', '10.2.2.100', None, None, None, None), ('dfba0188-78f7-4ef0-a411-0b8b98e093a6', '10.2.2.200', None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:40 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36df2251d9194760adcbdb9bf70ba341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616d5666496446ce828fde8a3dd0380b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c55d5cac-cb44-47bd-8735-ce57faa39c78 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e" status: 200 len: 1547 microversion: 2.1 time: 0.225635 Nov 28 00:42:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 33/95] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:42:40 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e => generated 1547 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:42:40 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:40 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Getting quotas for project 12a0f37585d44cc6a8f14651c74869c8. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Getting quotas for user c110bc80f8fa44f6863d2ebe961d2510 and project 12a0f37585d44cc6a8f14651c74869c8. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:42:41 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:41 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:41 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0f330133-3316-484e-9515-7db91813feec tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15" status: 200 len: 1626 microversion: 2.49 time: 0.387233 Nov 28 00:42:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 31/96] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:42:40 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15 => generated 1626 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:42:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='52865390-32c6-476c-b67a-61116319990f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6685b5b0-ebeb-4499-80de-9a81996811db',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b6b19a4-9b37-451a-a517-92a140e6c9f4',volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:42:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c23b911a-1fee-4210-85a5-7490d0505f9b tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 3.018647 Nov 28 00:42:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 33/97] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 28 00:42:38 2023] POST /compute/v2.1/servers => generated 403 bytes in 3020 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:42:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-92b662c6-f1b1-4d30-bbd0-bbcd96ecd3a2 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:41 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-92b662c6-f1b1-4d30-bbd0-bbcd96ecd3a2 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:41 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-92b662c6-f1b1-4d30-bbd0-bbcd96ecd3a2 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:41 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-92b662c6-f1b1-4d30-bbd0-bbcd96ecd3a2 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:41 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-92b662c6-f1b1-4d30-bbd0-bbcd96ecd3a2 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-92b662c6-f1b1-4d30-bbd0-bbcd96ecd3a2 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895" status: 200 len: 1276 microversion: 2.32 time: 0.084624 Nov 28 00:42:41 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 34/98] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:42:41 2023] GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:43 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4107c4de40db41478617a3e7740cdaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcf25cb4d7643beaf41d08d65c37c76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9a1c59aa-0322-4784-808c-c3be262483c7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24" status: 200 len: 1519 microversion: 2.1 time: 0.261156 Nov 28 00:42:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 32/99] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:42:43 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24 => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:42:47 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "tag": "b4b1bb66-214e-4774-96ca-91634121b5d5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:47 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] Creating event network-changed:b4b1bb66-214e-4774-96ca-91634121b5d5 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:42:47 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-2f2918fb-478b-44de-9ac0-dc08d0b62603 req-857c2db6-e72b-4609-af17-36d91b37d377 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034804 Nov 28 00:42:47 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:49 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "tag": "03619394-6a6e-497d-b570-4a288cdcd6f7"}, {"name": "network-changed", "server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "tag": "12d80f85-36dc-495d-9e2a-47ccaeafe267"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Creating event network-changed:03619394-6a6e-497d-b570-4a288cdcd6f7 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:42:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] Creating event network-changed:12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:42:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-81376fa2-74f9-44e3-84e6-d2a4e3c9c846 req-309656c4-ec65-4714-80fd-32b1b667782f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034685 Nov 28 00:42:49 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:49 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:42:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "tag": "93942af8-6733-4aa8-ab7a-6306b5196f30"}, {"name": "network-changed", "server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "tag": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52"}, {"name": "network-changed", "server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "tag": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:51 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Creating event network-changed:93942af8-6733-4aa8-ab7a-6306b5196f30 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:42:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Creating event network-changed:f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:42:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] Creating event network-changed:6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:42:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-8c6c0761-2cce-4882-8643-ddd58232ed45 req-b6c1b2ff-6a64-446c-986e-0eeb703cca78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.045598 Nov 28 00:42:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 33/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:51 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:52 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764878c5fd98438193043f4a5e812442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ed4d4553b4460ca8688714e6d7c335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:42:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6a360ea9-dee3-46db-97d4-fea4eb641d4a tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9" status: 200 len: 1550 microversion: 2.1 time: 0.294984 Nov 28 00:42:52 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 35/103] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:42:51 2023] GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9 => generated 1550 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:42:53 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:42:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "tag": "c986d58d-26af-42f2-b152-4e31e6403c2c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:42:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:42:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:42:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:42:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] Creating event network-changed:c986d58d-26af-42f2-b152-4e31e6403c2c for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:42:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-4611ae71-07f9-4f8e-928e-18e1dd8afbf1 req-d40005a9-fd5a-4b6a-a3a4-c92da0999372 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051966 Nov 28 00:42:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 36/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:42:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:03 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:03 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=14 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:03 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b87857a6-1074-4221-883a-4732a9bdfd5e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Action: 'create', calling method: .version_select at 0x7f49740f9a20>, body: {"keypair": {"name": "tempest-keypair-867180318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDV9oRV1wyim0sPI9SAlyevLGDgoxJX4WmEfY5ypsISajiixGHb150bg76nB7Ak8q1IJt+UTv38X7TheRdTKeSv00fCBixae2T3atzjMnCzv6q0GKf0tAXto0fhbm1Yaw=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:03 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-b87857a6-1074-4221-883a-4732a9bdfd5e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Getting quotas for project a97779a519d04d8bb60a0dfcfd23f347. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:43:03 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-b87857a6-1074-4221-883a-4732a9bdfd5e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Getting quotas for user 9c6f5f016eeb4e1fbb54d8b4163a1e69 and project a97779a519d04d8bb60a0dfcfd23f347. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:43:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b87857a6-1074-4221-883a-4732a9bdfd5e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184357 Nov 28 00:43:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 34/105] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:43:03 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "8e478814-6a3e-4ff6-8faa-dce421e62eaa"}], "security_groups": [{"name": "tempest-securitygroup--1174819104"}], "key_name": "tempest-keypair-867180318", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=10 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] validate_networks() for [('8e478814-6a3e-4ff6-8faa-dce421e62eaa', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Getting quotas for project a97779a519d04d8bb60a0dfcfd23f347. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Getting quotas for user 9c6f5f016eeb4e1fbb54d8b4163a1e69 and project a97779a519d04d8bb60a0dfcfd23f347. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:43:05 user devstack@n-api.service[65278]: WARNING nova.utils [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Hostname tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137725 is longer than 63, truncate it to tempest-TestServerVolumeAttachScenarioOldVersion-server-1773137 Nov 28 00:43:05 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:43:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-d95a5a9b-cbb0-4511-88c7-680da374cd33 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.564458 Nov 28 00:43:05 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 36/106] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:43:05 2023] POST /compute/v2.1/servers => generated 404 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:43:05 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=13 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:05 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=16 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:05 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-92561538-0374-43f9-a34b-d9d505c1c3f8 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:05 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-92561538-0374-43f9-a34b-d9d505c1c3f8 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:05 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-92561538-0374-43f9-a34b-d9d505c1c3f8 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f5f016eeb4e1fbb54d8b4163a1e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97779a519d04d8bb60a0dfcfd23f347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-92561538-0374-43f9-a34b-d9d505c1c3f8 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56" status: 200 len: 1249 microversion: 2.1 time: 0.077048 Nov 28 00:43:05 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 37/107] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:43:05 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56 => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:43:08 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2619f610-3a3c-4b48-9448-c30d75414e56", "tag": "8482d7a1-9b99-461b-aff7-9748c14d2529"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:08 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] Creating event network-changed:8482d7a1-9b99-461b-aff7-9748c14d2529 for instance 2619f610-3a3c-4b48-9448-c30d75414e56 on user Nov 28 00:43:08 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-4ac9a60b-d58b-44d8-b31f-a26f407b66d3 req-cb312abe-1593-48cb-86ea-4f4b581e7f60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033997 Nov 28 00:43:08 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 35/108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:09 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-539144485", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:09 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] validate_networks() for None {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Getting quotas for project 67f78eaf469545e2ba9232811de8e3a0. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Getting quotas for user f853e07c209544cf88d39ad0a2f3a694 and project 67f78eaf469545e2ba9232811de8e3a0. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:43:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:43:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-804885a3-8a0f-435f-a23b-fe3e16318beb tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.445000 Nov 28 00:43:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 37/109] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:43:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:43:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-89f1d04f-662a-4c3d-bdbc-aa7401f9ca7f tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:10 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-89f1d04f-662a-4c3d-bdbc-aa7401f9ca7f tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:10 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-89f1d04f-662a-4c3d-bdbc-aa7401f9ca7f tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f853e07c209544cf88d39ad0a2f3a694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f78eaf469545e2ba9232811de8e3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-89f1d04f-662a-4c3d-bdbc-aa7401f9ca7f tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" status: 200 len: 1206 microversion: 2.1 time: 0.073067 Nov 28 00:43:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 38/110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:43:10 2023] GET /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db => generated 1206 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 00:43:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2619f610-3a3c-4b48-9448-c30d75414e56", "name": "network-vif-plugged", "status": "completed", "tag": "8482d7a1-9b99-461b-aff7-9748c14d2529"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] Creating event network-vif-plugged:8482d7a1-9b99-461b-aff7-9748c14d2529 for instance 2619f610-3a3c-4b48-9448-c30d75414e56 on user Nov 28 00:43:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-b1658ed4-c4b8-4266-91a0-be995d751f21 req-85e0c148-8336-45da-9e6d-30e0634853fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039195 Nov 28 00:43:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 36/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:12 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2619f610-3a3c-4b48-9448-c30d75414e56", "name": "network-vif-plugged", "status": "completed", "tag": "8482d7a1-9b99-461b-aff7-9748c14d2529"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:12 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] Creating event network-vif-plugged:8482d7a1-9b99-461b-aff7-9748c14d2529 for instance 2619f610-3a3c-4b48-9448-c30d75414e56 on user Nov 28 00:43:12 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-5a555b57-8292-49fa-b87a-3adfff56bf91 req-0c581cef-f2da-4b7f-bc97-ef2eae45935e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048768 Nov 28 00:43:12 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db", "tag": "67eed799-ef90-48cc-a9c5-5c6243147147"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] Creating event network-changed:67eed799-ef90-48cc-a9c5-5c6243147147 for instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db on user Nov 28 00:43:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-ed08139c-808a-4f52-ae29-0a7e4c45038b req-b98600c7-0e47-48b9-a35c-9038acd53789 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042117 Nov 28 00:43:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:14 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:14 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db", "name": "network-vif-plugged", "status": "completed", "tag": "67eed799-ef90-48cc-a9c5-5c6243147147"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] Creating event network-vif-plugged:67eed799-ef90-48cc-a9c5-5c6243147147 for instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db on user Nov 28 00:43:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-545672d1-1d2d-4677-96cb-662a79dc4ee4 req-6d5c321e-479b-41dd-84bd-383be45bc9dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038695 Nov 28 00:43:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 37/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:15 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5f105bd8-3cdb-4ef1-bea6-ff86311ea478 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.220829 Nov 28 00:43:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 39/115] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:43:15 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/os-interface => generated 283 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-766186402"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:16 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-ee48eedf-c9c2-4449-b9e2-51423775e938 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/ips" status: 200 len: 104 microversion: 2.1 time: 0.093485 Nov 28 00:43:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 00:43:16 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/ips => generated 104 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:16 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'flavor' on Instance uuid 3f32bed1-593f-4bf4-ba26-9496d83fc17f {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:43:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-58b2802d-ff76-4f5a-8eb5-a69d3d182a40 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f/action" status: 200 len: 32 microversion: 2.1 time: 0.218510 Nov 28 00:43:16 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 40/117] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:43:16 2023] POST /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f/action => generated 32 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db", "name": "network-vif-plugged", "status": "completed", "tag": "67eed799-ef90-48cc-a9c5-5c6243147147"}, {"name": "network-changed", "server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Creating event network-vif-plugged:67eed799-ef90-48cc-a9c5-5c6243147147 for instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db on user Nov 28 00:43:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] Creating event network-changed:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:43:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-adceb1a5-c906-44af-af58-0e763f5d31bd req-7fb33569-abb1-41aa-8f87-9b85eafd24e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044678 Nov 28 00:43:17 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 41/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:16 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:17 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-21841148-31d9-42e7-af4f-3b0d3c5caf82 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f" status: 200 len: 1508 microversion: 2.1 time: 0.419920 Nov 28 00:43:17 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 39/119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:43:16 2023] GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:43:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a2b1b9c0-9e8f-4481-a83e-46d0be348824 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.230838 Nov 28 00:43:17 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 42/120] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:43:17 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3/os-interface => generated 283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:17 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-19f5214a-1030-4b63-8ed4-cff1c5f85885 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079/action" status: 202 len: 52 microversion: 2.87 time: 1.471943 Nov 28 00:43:17 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 40/121] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 00:43:16 2023] POST /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079/action => generated 52 bytes in 1475 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 28 00:43:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-unplugged", "status": "completed", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] Creating event network-vif-unplugged:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ae9a38e9-b447-4786-8249-149e90fa6a07 req-04a2f032-aab1-4cf2-8610-a5e53454a20d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048927 Nov 28 00:43:18 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:18 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-995feab9-e8e4-40bc-8c42-8426de02486e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1541 microversion: 2.1 time: 0.263143 Nov 28 00:43:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 43/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:43:18 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1541 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:43:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:19 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-8c1a3536-7e9d-4e5e-baaf-c198a1b6fbbb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1541 microversion: 2.1 time: 0.251115 Nov 28 00:43:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:43:18 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1541 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:43:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19151248-a33d-46b2-be99-0a85a5ab88d3", "tag": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] Creating event network-changed:e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance 19151248-a33d-46b2-be99-0a85a5ab88d3 on user Nov 28 00:43:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-66437d98-d95b-47ad-9da9-8e53e13835cb req-b72de277-9f13-4e2b-99ba-2c6cbfd80efa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040198 Nov 28 00:43:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50546c9b-1f14-449e-b7dd-a9376344f840"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:19 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "b4b1bb66-214e-4774-96ca-91634121b5d5"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:20 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:20 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=12 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] Creating event network-vif-plugged:b4b1bb66-214e-4774-96ca-91634121b5d5 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-66ec2286-4b4f-48d3-9665-5b26e8fefad0 req-25093d41-6026-4f2e-bc9b-5c00a2a1e536 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157463 Nov 28 00:43:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-bab4bb89-64f0-4b39-812c-084047329cbb tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888337 Nov 28 00:43:20 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 44/127] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:43:19 2023] POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:20 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-plugged", "status": "completed", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] Creating event network-vif-plugged:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:43:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-44da7b45-e863-4609-ad5a-62e146c0b7ad req-5c983f1b-fa1e-4f42-8813-d1f2dc446577 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057156 Nov 28 00:43:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:43:21 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:43:21 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "03619394-6a6e-497d-b570-4a288cdcd6f7"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "03619394-6a6e-497d-b570-4a288cdcd6f7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Creating event network-vif-plugged:03619394-6a6e-497d-b570-4a288cdcd6f7 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] Creating event network-vif-plugged:03619394-6a6e-497d-b570-4a288cdcd6f7 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-228a74af-29a1-4f9f-b25b-8b3ba685ffec req-aaa117be-9a59-4892-8f1a-1afde6001617 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071877 Nov 28 00:43:21 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "b4b1bb66-214e-4774-96ca-91634121b5d5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] Creating event network-vif-plugged:b4b1bb66-214e-4774-96ca-91634121b5d5 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-0f8f9ee8-a7cb-44cf-a8b6-b628f417d24c req-a0a6d7f4-3a25-4fd4-a36f-4fe4beb3a917 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035569 Nov 28 00:43:22 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 45/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "12d80f85-36dc-495d-9e2a-47ccaeafe267"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "12d80f85-36dc-495d-9e2a-47ccaeafe267"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Creating event network-vif-plugged:12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] Creating event network-vif-plugged:12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-cbdc4ae5-002a-412f-bb89-7d75665f3ddc req-f6386f7f-0d99-457a-8f24-925756ed9877 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040417 Nov 28 00:43:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 43/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "93942af8-6733-4aa8-ab7a-6306b5196f30"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "93942af8-6733-4aa8-ab7a-6306b5196f30"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Creating event network-vif-plugged:93942af8-6733-4aa8-ab7a-6306b5196f30 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] Creating event network-vif-plugged:93942af8-6733-4aa8-ab7a-6306b5196f30 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-3cbf4320-da2a-4f09-b290-bc1e2e87da49 req-54750f3e-98be-49b3-9f0a-604c727cdcd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031535 Nov 28 00:43:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 44/132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Creating event network-vif-plugged:f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] Creating event network-vif-plugged:f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-95a330ab-5d26-436a-b787-018b45d01d1c req-bd2a5425-09a3-4330-9b74-ebeb6f78f2a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044082 Nov 28 00:43:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 46/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:24 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-plugged", "status": "completed", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}, {"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-plugged", "status": "completed", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Creating event network-vif-plugged:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:43:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Creating event network-vif-plugged:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:43:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Creating event network-vif-plugged:6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] Creating event network-vif-plugged:6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-221e7c21-9779-4b6d-bff3-da6b2b60e4a2 req-67878da2-2816-4d5f-8c98-b820a4c2d0e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.045292 Nov 28 00:43:24 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 44/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:24 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:26 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "c986d58d-26af-42f2-b152-4e31e6403c2c"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "c986d58d-26af-42f2-b152-4e31e6403c2c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Creating event network-vif-plugged:c986d58d-26af-42f2-b152-4e31e6403c2c for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] Creating event network-vif-plugged:c986d58d-26af-42f2-b152-4e31e6403c2c for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:43:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5f05dfe4-fec5-4839-8a86-fe6c55d3e19b req-64dcb44d-41f0-47e8-8852-75b84a5333c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030133 Nov 28 00:43:26 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:31 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:31 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ff062946-63c6-487a-b9bf-cdd453d3748e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.162784 Nov 28 00:43:31 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 47/136] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:43:31 2023] GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-interface => generated 282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:32 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:32 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:32 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-aa356bbf-a73e-4489-982e-f3b25b8f3fc5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079" status: 200 len: 1702 microversion: 2.87 time: 0.621412 Nov 28 00:43:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 45/137] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:43:31 2023] GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079 => generated 1702 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f443cac-7a1c-49d2-9ed1-79a13883688a", "tag": "7b8ba726-9082-4459-86ba-f4317c342dbe"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] Creating event network-changed:7b8ba726-9082-4459-86ba-f4317c342dbe for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a on user Nov 28 00:43:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-62b17ebb-aa3e-459c-8861-e6fe79554635 req-3326abb5-ddca-49b1-b7e5-aa2d8b73e1c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033833 Nov 28 00:43:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 48/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:32 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0994d8f4-5956-49fc-a981-d9b5ee3b9917 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895" status: 200 len: 2815 microversion: 2.32 time: 0.682578 Nov 28 00:43:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 46/139] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:43:32 2023] GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895 => generated 2815 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:43:32 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Going to try to stop instance {{(pid=65276) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 28 00:43:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-a7e21696-2ba2-4312-bc8c-10b9e3d51a9a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/action" status: 202 len: 0 microversion: 2.1 time: 0.157934 Nov 28 00:43:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 46/140] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:43:32 2023] POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-unplugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] Creating event network-vif-unplugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:43:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0536615d-727e-434a-800b-34dcdf3336db req-71e5f55b-747b-4d8f-a50b-18ce2d4be7c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046718 Nov 28 00:43:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:33 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-8276ef45-bb9c-4138-ac05-13d14868eaef tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1708 microversion: 2.1 time: 0.594840 Nov 28 00:43:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 49/142] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:43:32 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1708 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:43:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d514648-03b2-4c05-bf1e-78e75e393d2f"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:35 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:43:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-6ab19340-1c92-47ec-9a1f-f54a6dbffd02 req-c835a341-6b88-4f0e-ab51-d5d8a800f51a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033055 Nov 28 00:43:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 48/143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-8ced08d5-689e-4eb4-a9c3-32862e025717 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398342 Nov 28 00:43:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 47/144] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:43:35 2023] POST /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:40 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:40 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-637161f1-2770-4f78-8f27-a56d3a0cdea4 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.131514 Nov 28 00:43:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 50/145] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:43:40 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-interface => generated 283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:41 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-15ee1330-63d1-44ab-9031-975aaf846cd9 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.158994 Nov 28 00:43:41 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 49/146] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 00:43:41 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-interface => generated 282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:43:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8080c31-0df3-44ba-8586-b1ca39d9c97e", "tag": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] Creating event network-changed:f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e on user Nov 28 00:43:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-a524eb04-c5db-4a13-80a1-6d11bdc42795 req-7f935c22-5ced-4d48-b3d7-063afe788150 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051483 Nov 28 00:43:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 48/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:42 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86575409-89de-4408-a573-d069767ebb15", "tag": "734679ea-803f-454c-ad23-ed3bbd4951e5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:42 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] Creating event network-changed:734679ea-803f-454c-ad23-ed3bbd4951e5 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:43:42 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-d7197a17-9edf-4426-94d1-44852e5f003c req-89746da3-d87e-4649-8e73-5505223dee17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032192 Nov 28 00:43:42 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 51/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:42 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:42 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7b08d388-d202-48a6-9093-6ce5d91e045f tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15" status: 200 len: 1626 microversion: 2.49 time: 0.166547 Nov 28 00:43:42 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 50/149] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:43:42 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15 => generated 1626 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:43:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "5b54be82-c220-4ef0-a359-dd372e82dd41", "tag": "nic-tag"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:42 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:43 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-bf986dcb-4303-47c1-9c5b-2ad142a547e7 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.200573 Nov 28 00:43:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 52/150] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:43:43 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-interface => generated 282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55ed410b-6916-49f0-bb09-359798600e75"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:44 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86575409-89de-4408-a573-d069767ebb15", "tag": "cb19ffde-74b9-41c3-9577-eb9064e539a6"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] Creating event network-changed:cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:43:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-d2de9f35-d3d0-4c59-8084-f63a80e63a4b req-d5c85761-b95f-4fdc-a761-7c4bb4979b47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034108 Nov 28 00:43:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 53/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46fb5677-018f-4e32-b945-166600ec6a24", "tag": "d958f7e8-8730-4756-8515-ce61c1d1efce"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] Creating event network-changed:d958f7e8-8730-4756-8515-ce61c1d1efce for instance 46fb5677-018f-4e32-b945-166600ec6a24 on user Nov 28 00:43:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-60be7c0b-92c1-4963-94e7-f08d8ac684c7 req-83ff8bac-9090-40b2-9403-e3a811eda659 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046243 Nov 28 00:43:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 54/152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:43:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d4ec2bab-8572-4b0e-9310-88baefe015cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383101 Nov 28 00:43:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 51/153] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:43:44 2023] POST /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03ee4663-c44a-45b0-8721-f33b791fcbbf"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:45 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-96fb0172-d1ba-40be-a2fe-bd45f2a3b2b2 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "POST /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521733 Nov 28 00:43:45 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 55/154] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:43:44 2023] POST /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e8b8a94b-2051-489d-be1d-687517b0538e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.606061 Nov 28 00:43:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 49/155] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Nov 28 00:43:42 2023] POST /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-interface => generated 283 bytes in 3608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:43:46 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05f69d2e-08e3-4ffa-ab94-250d56a5431c", "tag": "volume-tag"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:46 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-plugged", "status": "completed", "tag": "cb19ffde-74b9-41c3-9577-eb9064e539a6"}, {"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-plugged", "status": "completed", "tag": "cb19ffde-74b9-41c3-9577-eb9064e539a6"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Creating event network-vif-plugged:cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:43:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] Creating event network-vif-plugged:cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:43:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-0a267c8b-f516-4583-aa9f-8e024dde6e59 req-bc942a5d-b524-4966-b37b-7651e49fc700 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038802 Nov 28 00:43:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 50/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4812064f-cf7a-47ca-9d3a-b31dda0f2e28"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:46 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-a0cdf677-7698-4fd0-a587-ef2af1e059d3 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.308887 Nov 28 00:43:46 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 52/157] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 00:43:46 2023] POST /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:43:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] HTTP exception thrown: Volume 4812064f-cf7a-47ca-9d3a-b31dda0f2e28 could not be found. Nov 28 00:43:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Returning 400 to user: Volume 4812064f-cf7a-47ca-9d3a-b31dda0f2e28 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:43:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ebe73be4-36bf-4070-9e15-f30251048f4a tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments/4d514648-03b2-4c05-bf1e-78e75e393d2f" status: 400 len: 107 microversion: 2.1 time: 0.398176 Nov 28 00:43:46 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 56/158] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 00:43:46 2023] PUT /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments/4d514648-03b2-4c05-bf1e-78e75e393d2f => generated 107 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:52 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:52 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4e5ee652-71b1-4258-83ce-3d980696278f tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.150409 Nov 28 00:43:52 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 53/159] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:43:52 2023] GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-interface => generated 283 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lazy-loading 'services' on Instance uuid 6f443cac-7a1c-49d2-9ed1-79a13883688a {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:43:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-5ef4ae59-6c42-4be2-a0ea-d784691ba2bd tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments/4d514648-03b2-4c05-bf1e-78e75e393d2f" status: 202 len: 0 microversion: 2.1 time: 6.297410 Nov 28 00:43:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 51/160] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:43:46 2023] DELETE /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments/4d514648-03b2-4c05-bf1e-78e75e393d2f => generated 0 bytes in 6300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:43:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:53 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdea5f7d-ce77-4c66-afac-ddc24baeabd9", "tag": "cd82c939-7f4c-4114-97c2-9a4f166d9e23"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] Creating event network-changed:cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 on user Nov 28 00:43:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-2bcbb830-e23b-4e21-931c-c1cc1b96011f req-0d35c0a8-49db-4b2f-9dc3-c124a8ab7586 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036666 Nov 28 00:43:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 54/161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:43:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-3bc51492-c0e4-400a-a30c-94f49a66254b tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062503 Nov 28 00:43:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 57/162] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:43:53 2023] GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7afd95d-540d-416f-bf05-2720e4123cae"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-ea7ea0cd-ca5d-4ac1-b143-f831bb2bb9d0 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] 10.0.0.210 "POST /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387188 Nov 28 00:43:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 52/163] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:43:53 2023] POST /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:55 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:55 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1795988e-9744-46d1-8a0d-6a64c573686c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Nov 28 00:43:55 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 55/164] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:43:55 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:55 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lazy-loading 'services' on Instance uuid b8080c31-0df3-44ba-8586-b1ca39d9c97e {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:43:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-81c4171f-a8ac-40b1-a995-04e6b4d30496 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments/55ed410b-6916-49f0-bb09-359798600e75" status: 202 len: 0 microversion: 2.1 time: 0.273636 Nov 28 00:43:55 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 58/165] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:43:55 2023] DELETE /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments/55ed410b-6916-49f0-bb09-359798600e75 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:43:55 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:55 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:56 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f5f016eeb4e1fbb54d8b4163a1e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97779a519d04d8bb60a0dfcfd23f347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:43:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-df7324ee-7e35-40ee-8fc8-84ba66b30140 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56" status: 200 len: 1574 microversion: 2.1 time: 0.274302 Nov 28 00:43:56 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 53/166] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:43:55 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56 => generated 1574 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:43:57 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:43:57 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-257ff052-81dd-4c53-bd49-d4fc167ce709 tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments/03ee4663-c44a-45b0-8721-f33b791fcbbf" status: 202 len: 0 microversion: 2.1 time: 0.458494 Nov 28 00:43:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 56/167] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 00:43:57 2023] PUT /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments/03ee4663-c44a-45b0-8721-f33b791fcbbf => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:43:59 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lazy-loading 'services' on Instance uuid 86575409-89de-4408-a573-d069767ebb15 {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:43:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-04ea4cdd-b535-4d0d-a5ed-24bdc19eaace tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-volume_attachments/05f69d2e-08e3-4ffa-ab94-250d56a5431c" status: 202 len: 0 microversion: 2.49 time: 0.181771 Nov 28 00:43:59 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 59/168] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 00:43:59 2023] DELETE /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-volume_attachments/05f69d2e-08e3-4ffa-ab94-250d56a5431c => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:00 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f853e07c209544cf88d39ad0a2f3a694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f78eaf469545e2ba9232811de8e3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-642aa9ca-eec6-454e-a6e3-e43e6af5e196 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" status: 200 len: 1451 microversion: 2.1 time: 0.196937 Nov 28 00:44:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 54/169] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:00 2023] GET /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:44:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a7afd95d-540d-416f-bf05-2720e4123cae", "create_info": {"snapshot_id": "55850b93-9db7-4814-9260-2c69dfa403d8", "type": "qcow2", "new_file": "new_file"}}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:04 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3099e656-1610-4c42-b3b1-20ed37c4bef8(cell1) {{(pid=65277) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 28 00:44:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-8c190ead-d930-437e-a733-be2ffdeb25ca tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] 10.0.0.210 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.243668 Nov 28 00:44:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 57/170] 10.0.0.210 () {64 vars in 1287 bytes} [Tue Nov 28 00:44:04 2023] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:44:04 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:04 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3099e656-1610-4c42-b3b1-20ed37c4bef8(cell1) {{(pid=65278) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 28 00:44:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:04 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-539274a3-e0b7-451a-83e1-f3bb62c745ac tempest-VolumesAssistedSnapshotsTest-1242641545 tempest-VolumesAssistedSnapshotsTest-1242641545-project] 10.0.0.210 "DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%22a7afd95d-540d-416f-bf05-2720e4123cae%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.077059 Nov 28 00:44:04 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 60/171] 10.0.0.210 () {62 vars in 1442 bytes} [Tue Nov 28 00:44:04 2023] DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%22a7afd95d-540d-416f-bf05-2720e4123cae%22%7D => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:04 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:05 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lazy-loading 'services' on Instance uuid fdea5f7d-ce77-4c66-afac-ddc24baeabd9 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:44:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-01180932-3f38-423b-80ec-19571179210e tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] 10.0.0.210 "DELETE /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-volume_attachments/a7afd95d-540d-416f-bf05-2720e4123cae" status: 202 len: 0 microversion: 2.1 time: 0.242039 Nov 28 00:44:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 55/172] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:44:04 2023] DELETE /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-volume_attachments/a7afd95d-540d-416f-bf05-2720e4123cae => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:44:05 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:05 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5073bb57-264d-48e8-a79f-5e42ddb81f84 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059006 Nov 28 00:44:05 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:05 2023] GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=120,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:07 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-898471da-13c8-4c07-9694-f5a6bd45d01e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f" status: 200 len: 1488 microversion: 2.1 time: 0.209193 Nov 28 00:44:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 61/174] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:07 2023] GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f => generated 1488 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:09 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-ca2a4114-c57a-4f79-a334-d0b356f42005 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1660 microversion: 2.1 time: 0.295188 Nov 28 00:44:09 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 56/175] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:09 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1660 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=49 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=101,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:09 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6669f5b2-2527-4a77-93a1-612afbdb29b7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1660 microversion: 2.1 time: 0.315001 Nov 28 00:44:09 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:09 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1660 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:44:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:14 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-38444148-1c22-4299-ad0e-d261472fb67c tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Nov 28 00:44:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 62/177] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:14 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:14 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:14 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d221156f-b32d-43ac-bc81-1deb67ccf56a tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046981 Nov 28 00:44:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 57/178] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:14 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "03ee4663-c44a-45b0-8721-f33b791fcbbf"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:14 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-167a8f85-7805-48ad-9602-19e8c490e3ae tempest-TestVolumeSwap-346404310 tempest-TestVolumeSwap-346404310-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments/f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24" status: 202 len: 0 microversion: 2.1 time: 0.302715 Nov 28 00:44:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 60/179] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 00:44:14 2023] PUT /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments/f5ea32ca-7e01-43d1-95f9-35c6b0a0bb24 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-003244b7-f055-4988-9ce0-f1ffaa029c4c tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048021 Nov 28 00:44:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 63/180] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:18 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-28d28a5f-5598-4be7-a5f0-f807b4d981b5 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047778 Nov 28 00:44:18 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 58/181] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:18 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:44:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-51f34cba-0878-4a57-8696-2d0ab053112f tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e" status: 204 len: 0 microversion: 2.1 time: 0.135852 Nov 28 00:44:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:44:18 2023] DELETE /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36df2251d9194760adcbdb9bf70ba341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616d5666496446ce828fde8a3dd0380b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6afa3708-115d-40ef-b1b9-b1307fca28a6 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e" status: 200 len: 1671 microversion: 2.1 time: 0.284377 Nov 28 00:44:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 64/183] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:18 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e => generated 1671 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8080c31-0df3-44ba-8586-b1ca39d9c97e", "name": "network-vif-unplugged", "status": "completed", "tag": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] Creating event network-vif-unplugged:f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e on user Nov 28 00:44:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-abaf71a6-e9d8-4db3-b71e-c07e1576bf4a req-91ef59fc-8f34-4d20-bb4a-19f4b6e2e210 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032768 Nov 28 00:44:18 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 59/184] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8080c31-0df3-44ba-8586-b1ca39d9c97e", "name": "network-vif-plugged", "status": "completed", "tag": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c"}, {"server_uuid": "b8080c31-0df3-44ba-8586-b1ca39d9c97e", "name": "network-vif-deleted", "tag": "f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Creating event network-vif-plugged:f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e on user Nov 28 00:44:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] Creating event network-vif-deleted:f9537aa9-c3c5-4cbf-8fe9-d8bd0138d55c for instance b8080c31-0df3-44ba-8586-b1ca39d9c97e on user Nov 28 00:44:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-aff53b71-d871-4c6d-a705-584776efba85 req-a5eab63c-5ba5-41db-b58c-0aba1d994e2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036249 Nov 28 00:44:21 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 62/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:21 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-interface/cb19ffde-74b9-41c3-9577-eb9064e539a6" status: 202 len: 0 microversion: 2.49 time: 0.046391 Nov 28 00:44:21 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 65/186] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Nov 28 00:44:21 2023] DELETE /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-interface/cb19ffde-74b9-41c3-9577-eb9064e539a6 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:44:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:22 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-98293f3d-df8c-41ca-b385-27e5bed2da3b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-instance-actions/req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42" status: 200 len: 474 microversion: 2.49 time: 0.246509 Nov 28 00:44:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 60/187] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 00:44:21 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-instance-actions/req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 => generated 474 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:22 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-43b11ebb-f60f-4f07-abdf-2489eb8bc9a0 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079" status: 200 len: 1689 microversion: 2.87 time: 0.280860 Nov 28 00:44:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 63/188] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:44:22 2023] GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079 => generated 1689 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:44:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-unplugged", "status": "completed", "tag": "cb19ffde-74b9-41c3-9577-eb9064e539a6"}, {"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-plugged", "status": "completed", "tag": "cb19ffde-74b9-41c3-9577-eb9064e539a6"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Creating event network-vif-unplugged:cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:44:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] Creating event network-vif-plugged:cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:44:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-a2ab93ce-ff8d-40f9-9999-11f13b240649 req-0d5273e6-f317-4307-8501-77b7b3111b7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032692 Nov 28 00:44:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 66/189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:23 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:23 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:23 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-292f427a-6845-446c-81ad-b55edf916edd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1685 microversion: 2.1 time: 0.202142 Nov 28 00:44:23 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 61/190] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:23 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1685 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:44:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:29 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e4d23b0e-2cd6-400a-a758-658ee43bcf32 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Nov 28 00:44:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:29 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:29 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:29 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7fd3355e-8b0f-497f-b99b-883643d95cf4 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Nov 28 00:44:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 67/192] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:29 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:29 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lazy-loading 'services' on Instance uuid 46fb5677-018f-4e32-b945-166600ec6a24 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:44:30 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f6f46d27-5cd9-4988-95df-cb13434705cd tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments/03ee4663-c44a-45b0-8721-f33b791fcbbf" status: 202 len: 0 microversion: 2.1 time: 0.193507 Nov 28 00:44:30 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 62/193] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:44:29 2023] DELETE /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments/03ee4663-c44a-45b0-8721-f33b791fcbbf => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:44:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:30 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1f471d07-63cd-4cbf-b2c2-01f8e6874f31 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Nov 28 00:44:30 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:30 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:32 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7e7bc792-86b0-45a6-be95-dbeb54cc89b7 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.274837 Nov 28 00:44:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 68/195] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 00:44:32 2023] GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895/os-interface => generated 1829 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:44:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "tag": "b4b1bb66-214e-4774-96ca-91634121b5d5"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] Creating event network-changed:b4b1bb66-214e-4774-96ca-91634121b5d5 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-174759a5-44fd-4a58-b655-e736e663792b req-534d7475-54ad-44e6-ab2f-518d35abcacc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035734 Nov 28 00:44:34 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 63/196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:34 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-71ea8e17-5443-4019-9514-5ccc043d7a6f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895" status: 200 len: 2815 microversion: 2.32 time: 0.420122 Nov 28 00:44:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 66/197] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:44:34 2023] GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895 => generated 2815 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:44:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-be3010bf-79e4-4814-8edb-2147f90b133f tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.113724 Nov 28 00:44:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 69/198] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 00:44:34 2023] GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895/os-interface => generated 1829 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:44:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-56198656-e149-47ce-92d8-3684009a0be6 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895" status: 204 len: 0 microversion: 2.32 time: 0.155051 Nov 28 00:44:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 64/199] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:44:36 2023] DELETE /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c110bc80f8fa44f6863d2ebe961d2510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a0f37585d44cc6a8f14651c74869c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-20b13df9-9630-4a28-8029-cb7ee93a8810 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895" status: 200 len: 2939 microversion: 2.32 time: 0.211457 Nov 28 00:44:36 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 67/200] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:44:36 2023] GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895 => generated 2939 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:44:36 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-unplugged", "status": "completed", "tag": "b4b1bb66-214e-4774-96ca-91634121b5d5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] Creating event network-vif-unplugged:b4b1bb66-214e-4774-96ca-91634121b5d5 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-fc1ea937-2796-49b9-abe3-9f7cb49ccab8 req-bfccd8c8-b774-42fa-bc77-dcd11c953004 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031091 Nov 28 00:44:36 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 70/201] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-unplugged", "status": "completed", "tag": "03619394-6a6e-497d-b570-4a288cdcd6f7"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] Creating event network-vif-unplugged:03619394-6a6e-497d-b570-4a288cdcd6f7 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-7301e40e-35dd-4dd8-b9bd-2e6b498adbd8 req-e3ca856e-f897-47df-987a-7968e89720d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046518 Nov 28 00:44:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 65/202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-unplugged", "status": "completed", "tag": "12d80f85-36dc-495d-9e2a-47ccaeafe267"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] Creating event network-vif-unplugged:12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5f3ad598-534c-4f0b-85d7-b0af30e03607 req-0bceebd7-76ed-4f65-b29d-0accae23a3f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036311 Nov 28 00:44:36 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 68/203] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "b4b1bb66-214e-4774-96ca-91634121b5d5"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-unplugged", "status": "completed", "tag": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Creating event network-vif-plugged:b4b1bb66-214e-4774-96ca-91634121b5d5 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Creating event network-vif-unplugged:f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] Creating event network-vif-plugged:f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-ca26746b-e8d7-462b-afad-808ce4aeeaee req-73927edb-1bc7-42af-a536-c2b63afadf34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.031129 Nov 28 00:44:38 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 71/204] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:38 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:38 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "03619394-6a6e-497d-b570-4a288cdcd6f7"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-unplugged", "status": "completed", "tag": "93942af8-6733-4aa8-ab7a-6306b5196f30"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "93942af8-6733-4aa8-ab7a-6306b5196f30"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Creating event network-vif-plugged:03619394-6a6e-497d-b570-4a288cdcd6f7 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Creating event network-vif-unplugged:93942af8-6733-4aa8-ab7a-6306b5196f30 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] Creating event network-vif-plugged:93942af8-6733-4aa8-ab7a-6306b5196f30 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-8d67dd8e-9a78-4231-a8cf-f7cc209cae02 req-02a3f5e8-e882-4b1c-8be3-dde29edd3ae8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.119755 Nov 28 00:44:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 66/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:38 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "12d80f85-36dc-495d-9e2a-47ccaeafe267"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-unplugged", "status": "completed", "tag": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-unplugged", "status": "completed", "tag": "c986d58d-26af-42f2-b152-4e31e6403c2c"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-plugged", "status": "completed", "tag": "c986d58d-26af-42f2-b152-4e31e6403c2c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Creating event network-vif-plugged:12d80f85-36dc-495d-9e2a-47ccaeafe267 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Creating event network-vif-unplugged:6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Creating event network-vif-plugged:6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Creating event network-vif-unplugged:c986d58d-26af-42f2-b152-4e31e6403c2c for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] Creating event network-vif-plugged:c986d58d-26af-42f2-b152-4e31e6403c2c for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-76444987-087b-4d34-a499-5797c9f68cd2 req-364b9198-3d1e-4765-b87a-402d419151d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.033771 Nov 28 00:44:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 69/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:38 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-deleted", "tag": "c986d58d-26af-42f2-b152-4e31e6403c2c"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] Creating event network-vif-deleted:c986d58d-26af-42f2-b152-4e31e6403c2c for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-da2c21ef-f662-4719-986d-286abe47615b req-853fa894-423b-4b74-9f3f-1eed0ec17bfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031713 Nov 28 00:44:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 72/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-deleted", "tag": "cb19ffde-74b9-41c3-9577-eb9064e539a6"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] Creating event network-vif-deleted:cb19ffde-74b9-41c3-9577-eb9064e539a6 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:44:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-0108b496-ac42-4969-9fa2-fe9c484b5137 req-ca45de98-4420-4651-896a-632126fdd299 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056135 Nov 28 00:44:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 67/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:43 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:43 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:43 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1291f46a-03e4-4e43-bcd3-307573859e28 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043706 Nov 28 00:44:43 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:43 2023] GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:44:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-deleted", "tag": "b4b1bb66-214e-4774-96ca-91634121b5d5"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-deleted", "tag": "6b322b03-7a4e-4a72-8a3d-3cc3a485f801"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-deleted", "tag": "f6ea4af3-eb88-4c03-a3bf-c852a8464e52"}, {"server_uuid": "51a4dd5e-3313-4c04-a699-9184465e9895", "name": "network-vif-deleted", "tag": "93942af8-6733-4aa8-ab7a-6306b5196f30"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] Creating event network-vif-deleted:b4b1bb66-214e-4774-96ca-91634121b5d5 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] Creating event network-vif-deleted:6b322b03-7a4e-4a72-8a3d-3cc3a485f801 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] Creating event network-vif-deleted:f6ea4af3-eb88-4c03-a3bf-c852a8464e52 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] Creating event network-vif-deleted:93942af8-6733-4aa8-ab7a-6306b5196f30 for instance 51a4dd5e-3313-4c04-a699-9184465e9895 on user Nov 28 00:44:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-32d66a5c-019d-498a-a0bb-ff34f789b0cf req-311d8947-0235-4906-a4cf-b4823fc76409 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.034507 Nov 28 00:44:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 73/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-690874260", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "5e24bcbb-fe85-4019-a107-ea0b5809297e"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:43 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] validate_networks() for [('5e24bcbb-fe85-4019-a107-ea0b5809297e', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting quotas for project ea1afcbb4b3643c5ae366c8e39f3d8ed. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Getting quotas for user 6657488fa71b469c954276af7717308e and project ea1afcbb4b3643c5ae366c8e39f3d8ed. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:44:44 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:44:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d76a120c-22fe-454e-8b19-52168cc1a2e4 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.535146 Nov 28 00:44:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 68/211] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:44:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 28 00:44:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4b2d82b5-7f83-478e-97e6-be8ad5dbce19 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:44 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4b2d82b5-7f83-478e-97e6-be8ad5dbce19 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:44 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4b2d82b5-7f83-478e-97e6-be8ad5dbce19 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6657488fa71b469c954276af7717308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1afcbb4b3643c5ae366c8e39f3d8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4b2d82b5-7f83-478e-97e6-be8ad5dbce19 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3" status: 200 len: 1209 microversion: 2.1 time: 0.091522 Nov 28 00:44:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 71/212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:44 2023] GET /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:44:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e00566-f7d4-4022-9377-94fcb8f54fd3", "tag": "09f3cea2-142d-4c24-8c21-27880492615b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] Creating event network-changed:09f3cea2-142d-4c24-8c21-27880492615b for instance d9e00566-f7d4-4022-9377-94fcb8f54fd3 on user Nov 28 00:44:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-f970f930-9e74-4255-9bc0-1f0a8829c93c req-1778600a-5b39-4d10-9ac2-df360be4f157 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028749 Nov 28 00:44:46 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 74/213] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:48 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e00566-f7d4-4022-9377-94fcb8f54fd3", "name": "network-vif-plugged", "status": "completed", "tag": "09f3cea2-142d-4c24-8c21-27880492615b"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:49 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] Creating event network-vif-plugged:09f3cea2-142d-4c24-8c21-27880492615b for instance d9e00566-f7d4-4022-9377-94fcb8f54fd3 on user Nov 28 00:44:49 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-2b252fda-cd09-4472-b2e1-0a98c8af0b49 req-e58093c0-3b23-4354-a6ed-e65c372e3a8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030280 Nov 28 00:44:49 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 69/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:51 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e00566-f7d4-4022-9377-94fcb8f54fd3", "name": "network-vif-plugged", "status": "completed", "tag": "09f3cea2-142d-4c24-8c21-27880492615b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] Creating event network-vif-plugged:09f3cea2-142d-4c24-8c21-27880492615b for instance d9e00566-f7d4-4022-9377-94fcb8f54fd3 on user Nov 28 00:44:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-8607ce26-a9d4-4036-bfc0-3c7530153ac8 req-1701d5aa-d5cd-4b14-8869-b7ea0c390007 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039453 Nov 28 00:44:51 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 72/215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:55 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:55 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-36339823-eb43-4af5-a862-3bc70c22af73 tempest-VolumesAssistedSnapshotsTest-705712652 tempest-VolumesAssistedSnapshotsTest-705712652-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047834 Nov 28 00:44:55 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 75/216] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:44:55 2023] GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-62c893e7-a620-4df2-b76f-385c1cfc581f tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.158891 Nov 28 00:44:56 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 70/217] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:44:56 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-interface => generated 282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:56 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2619f610-3a3c-4b48-9448-c30d75414e56", "tag": "8482d7a1-9b99-461b-aff7-9748c14d2529"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:56 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:44:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] Creating event network-changed:8482d7a1-9b99-461b-aff7-9748c14d2529 for instance 2619f610-3a3c-4b48-9448-c30d75414e56 on user Nov 28 00:44:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-b3011214-ffed-4fde-9daa-3bb5d2fe08b3 req-30af1e81-da54-42d3-82a0-deeb05b50a9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039400 Nov 28 00:44:56 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 73/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:57 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f5f016eeb4e1fbb54d8b4163a1e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97779a519d04d8bb60a0dfcfd23f347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-21d0110a-5141-4a51-86b8-b6cc3b40a297 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56" status: 200 len: 1574 microversion: 2.1 time: 0.208273 Nov 28 00:44:57 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 76/219] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:57 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56 => generated 1574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c6f5f016eeb4e1fbb54d8b4163a1e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97779a519d04d8bb60a0dfcfd23f347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Searching by: {'deleted': False, 'project_id': 'a97779a519d04d8bb60a0dfcfd23f347'} {{(pid=65276) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:57 user devstack@n-api.service[65276]: DEBUG nova.compute.multi_cell_list [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65276) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 00:44:57 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1bccc5eb-8ab3-4399-84f8-df86da3c5522 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 357 microversion: 2.1 time: 0.192921 Nov 28 00:44:57 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 71/220] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 00:44:57 2023] GET /compute/v2.1/servers => generated 357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:58 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:44:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2231a778-dda4-42ef-9926-87e4314e17df tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9" status: 204 len: 0 microversion: 2.1 time: 0.120647 Nov 28 00:44:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 74/221] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:44:58 2023] DELETE /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:44:58 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:44:58 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:59 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdea5f7d-ce77-4c66-afac-ddc24baeabd9", "name": "network-vif-unplugged", "status": "completed", "tag": "cd82c939-7f4c-4114-97c2-9a4f166d9e23"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:59 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764878c5fd98438193043f4a5e812442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ed4d4553b4460ca8688714e6d7c335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:44:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6cc9c133-db34-46c3-918b-ffb896ac776b tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9" status: 200 len: 1675 microversion: 2.1 time: 0.265245 Nov 28 00:44:59 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 77/222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:44:58 2023] GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9 => generated 1675 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:44:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] Creating event network-vif-unplugged:cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 on user Nov 28 00:44:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-cc84d4ca-d59b-4848-99e9-a54bf8dc546b req-1dfb9553-d9e2-4746-8c74-b63ed4ffc785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033185 Nov 28 00:44:59 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 72/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:44:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:44:59 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "690a2933-f2cc-4d04-b41a-41189277b740"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:44:59 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:44:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:44:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:44:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:44:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-fcdaf9a5-8b06-411f-a4b1-cef8f81d49c9 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317312 Nov 28 00:45:00 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 75/224] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:44:59 2023] POST /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:00 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:45:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-3b5c1694-1605-49e3-a9e9-7646570856e9 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" status: 204 len: 0 microversion: 2.1 time: 0.162733 Nov 28 00:45:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 78/225] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:45:00 2023] DELETE /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:45:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdea5f7d-ce77-4c66-afac-ddc24baeabd9", "name": "network-vif-deleted", "tag": "cd82c939-7f4c-4114-97c2-9a4f166d9e23"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] Creating event network-vif-deleted:cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 on user Nov 28 00:45:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-fb37077e-426b-41d9-94e3-dbb99c9e4849 req-bff6e2fd-d3a2-4749-a5ab-2995035a737f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044725 Nov 28 00:45:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 76/226] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdea5f7d-ce77-4c66-afac-ddc24baeabd9", "name": "network-vif-plugged", "status": "completed", "tag": "cd82c939-7f4c-4114-97c2-9a4f166d9e23"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] Creating event network-vif-plugged:cd82c939-7f4c-4114-97c2-9a4f166d9e23 for instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 on user Nov 28 00:45:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-905b51d1-7a52-496a-94e5-c915a1c2fa69 req-c2d6d7fd-2f24-4f68-9255-5b0de9274f7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048492 Nov 28 00:45:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 79/227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:01 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f853e07c209544cf88d39ad0a2f3a694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f78eaf469545e2ba9232811de8e3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-76c5fa74-665e-4453-bc35-3e769495eab8 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" status: 200 len: 1457 microversion: 2.1 time: 0.307631 Nov 28 00:45:01 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 73/228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:00 2023] GET /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db => generated 1457 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:45:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db", "name": "network-vif-unplugged", "status": "completed", "tag": "67eed799-ef90-48cc-a9c5-5c6243147147"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] Creating event network-vif-unplugged:67eed799-ef90-48cc-a9c5-5c6243147147 for instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db on user Nov 28 00:45:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-d3694a49-1189-46b9-930f-cf04a38a78e6 req-691bb47a-db4a-4e54-a624-2898af4a6c45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031254 Nov 28 00:45:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-fa380b41-8dc6-41ad-9cbc-ab0ca1c7d2f3 req-3e5cf996-8494-4e22-9d48-0dea79103f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db", "name": "network-vif-deleted", "tag": "67eed799-ef90-48cc-a9c5-5c6243147147"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fa380b41-8dc6-41ad-9cbc-ab0ca1c7d2f3 req-3e5cf996-8494-4e22-9d48-0dea79103f67 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fa380b41-8dc6-41ad-9cbc-ab0ca1c7d2f3 req-3e5cf996-8494-4e22-9d48-0dea79103f67 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fa380b41-8dc6-41ad-9cbc-ab0ca1c7d2f3 req-3e5cf996-8494-4e22-9d48-0dea79103f67 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-fa380b41-8dc6-41ad-9cbc-ab0ca1c7d2f3 req-3e5cf996-8494-4e22-9d48-0dea79103f67 service nova] Creating event network-vif-deleted:67eed799-ef90-48cc-a9c5-5c6243147147 for instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db on user Nov 28 00:45:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-fa380b41-8dc6-41ad-9cbc-ab0ca1c7d2f3 req-3e5cf996-8494-4e22-9d48-0dea79103f67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029158 Nov 28 00:45:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 80/230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:03 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2dca4b-65fc-4db5-a4f0-60d592d1a4db", "name": "network-vif-plugged", "status": "completed", "tag": "67eed799-ef90-48cc-a9c5-5c6243147147"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] Creating event network-vif-plugged:67eed799-ef90-48cc-a9c5-5c6243147147 for instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db on user Nov 28 00:45:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-3031cc4a-9c04-40d2-ae7e-9f2735bd3f0e req-726ef92b-4f74-45fb-9a45-6cf6ab6a3548 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030325 Nov 28 00:45:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 74/231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:07 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-87f9db26-3f4c-4d38-8634-489eff6d5a7b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 200 len: 1502 microversion: 2.1 time: 0.339771 Nov 28 00:45:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 78/232] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:07 2023] GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 1502 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] HTTP exception thrown: Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e could not be found. Nov 28 00:45:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Returning 404 to user: Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:45:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-bf637cb8-0e9c-4d98-a0aa-774c2d0c7b27 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e" status: 404 len: 111 microversion: 2.1 time: 0.041277 Nov 28 00:45:08 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 81/233] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:08 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:45:08 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:08 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2a0380df-17cf-49ca-af1e-307103469806 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '.version_select at 0x7f497314a710>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2a0380df-17cf-49ca-af1e-307103469806 tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026390778" status: 202 len: 0 microversion: 2.1 time: 0.032116 Nov 28 00:45:09 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 75/234] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 00:45:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026390778 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:45:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-061964fb-71d7-4fb8-8c77-2c0e4fb108d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'create', calling method: .version_select at 0x7f4973464f70>, body: {"keypair": {"name": "tempest-keypair-1264480328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQJB3c+eyqLQ8kN0nRWjpAKHOkxo9RuPOOJdNm2fTKprwEnuPArhQhhcLc4CGS3csNO/5Bj+O3YVX9jo5CRgIp3HAHy93WoEu8FqYq2Z6A1eEGCR285rc5LosVD0aS60Q=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:10 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:10 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-061964fb-71d7-4fb8-8c77-2c0e4fb108d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:45:10 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-061964fb-71d7-4fb8-8c77-2c0e4fb108d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for user f63a0e9261934c8b8e673f069c3376bd and project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:45:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-061964fb-71d7-4fb8-8c77-2c0e4fb108d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079334 Nov 28 00:45:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 79/235] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:45:10 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-c6e5ba8a-7c7b-443e-9f76-b1d0612a7ed8 req-a70dd473-d7b8-48e8-941d-1493aa289ffd tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments/690a2933-f2cc-4d04-b41a-41189277b740" status: 200 len: 302 microversion: 2.89 time: 0.096730 Nov 28 00:45:11 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 82/236] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 00:45:10 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments/690a2933-f2cc-4d04-b41a-41189277b740 => generated 302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG nova.compute.api [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=101,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-3d85cf29-c0aa-4022-9031-05cd87ac0294 req-1bcc6722-e32b-4d57-a57a-5fea762fabfe tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments/690a2933-f2cc-4d04-b41a-41189277b740" status: 200 len: 302 microversion: 2.89 time: 0.145447 Nov 28 00:45:11 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 76/237] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 00:45:11 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments/690a2933-f2cc-4d04-b41a-41189277b740 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=112,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:11 user devstack@n-api.service[65277]: DEBUG nova.objects.instance [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lazy-loading 'services' on Instance uuid 2619f610-3a3c-4b48-9448-c30d75414e56 {{(pid=65277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:45:11 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7088f35e-0e67-4c42-94a3-5a878312943e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments/690a2933-f2cc-4d04-b41a-41189277b740" status: 202 len: 0 microversion: 2.1 time: 0.245208 Nov 28 00:45:11 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 80/238] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:45:11 2023] DELETE /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments/690a2933-f2cc-4d04-b41a-41189277b740 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:45:11 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:11 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-30fa0464-bfaf-4ea3-a604-497670d02bf0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Nov 28 00:45:11 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 83/239] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:45:11 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1551649898", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "1fef710f-91b8-46ea-a616-1a2c3c3ff203"}], "security_groups": [{"name": "tempest-securitygroup--2041096846"}], "key_name": "tempest-keypair-1264480328", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:11 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] validate_networks() for [('1fef710f-91b8-46ea-a616-1a2c3c3ff203', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for user f63a0e9261934c8b8e673f069c3376bd and project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:45:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5799a998-b768-42fc-a688-e27e316ed2ae tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-instance-actions/req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42" status: 200 len: 503 microversion: 2.49 time: 0.104639 Nov 28 00:45:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 81/240] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 00:45:12 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-instance-actions/req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 => generated 503 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-4f204b30-ded1-4097-a07f-34f3a97e60d6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.576094 Nov 28 00:45:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 77/241] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:45:11 2023] POST /compute/v2.1/servers => generated 404 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-f10afa36-cfe5-4caf-bdd7-03940d05acd7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f10afa36-cfe5-4caf-bdd7-03940d05acd7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:12 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f5002bb0-c3ce-42f3-8378-ee83e473c46b tempest-TaggedAttachmentsTest-425170748 tempest-TaggedAttachmentsTest-425170748-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-instance-actions/req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42" status: 200 len: 503 microversion: 2.49 time: 0.089657 Nov 28 00:45:12 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 84/242] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 00:45:12 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-instance-actions/req-f9179824-8dad-45b9-bbd4-6c2c5aa5fe42 => generated 503 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-f10afa36-cfe5-4caf-bdd7-03940d05acd7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-f10afa36-cfe5-4caf-bdd7-03940d05acd7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 200 len: 1234 microversion: 2.1 time: 0.060871 Nov 28 00:45:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 82/243] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:12 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 1234 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c8a5de6d-47f3-4aca-b137-3abce82f0494 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.052878 Nov 28 00:45:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 78/244] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 00:45:12 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:45:12 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e92da275-c4bf-4d21-9a8b-da05df2d7055 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15" status: 204 len: 0 microversion: 2.49 time: 0.152474 Nov 28 00:45:12 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 85/245] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:45:12 2023] DELETE /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-unplugged", "status": "completed", "tag": "734679ea-803f-454c-ad23-ed3bbd4951e5"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:12 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fa42e3664c64c9696a0bbd62853c291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b41d15ebfac4bb8aa32e310b2b2adee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4c9c5fab-36f6-4737-813e-1a2afe449f4e tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15" status: 200 len: 1751 microversion: 2.49 time: 0.238880 Nov 28 00:45:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 83/246] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:45:12 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15 => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] Creating event network-vif-unplugged:734679ea-803f-454c-ad23-ed3bbd4951e5 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:45:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-90c6cde3-302d-4946-b386-4fe80a977db3 req-0fbdc7e9-88e0-4fae-8d8d-5f2f55bb2fe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035404 Nov 28 00:45:13 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 79/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:13 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] HTTP exception thrown: Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e could not be found. Nov 28 00:45:13 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Returning 404 to user: Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:45:13 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5c84f00a-e622-4862-980a-4d1a380c33cb tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e" status: 404 len: 111 microversion: 2.1 time: 0.053029 Nov 28 00:45:13 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 86/248] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:45:13 2023] DELETE /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] [instance: b8080c31-0df3-44ba-8586-b1ca39d9c97e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] HTTP exception thrown: Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e could not be found. Nov 28 00:45:13 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] Returning 404 to user: Instance b8080c31-0df3-44ba-8586-b1ca39d9c97e could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:45:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-29a80e43-b05f-48ed-87bf-6fee3d903eae tempest-AttachSCSIVolumeTestJSON-1035698266 tempest-AttachSCSIVolumeTestJSON-1035698266-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e" status: 404 len: 111 microversion: 2.1 time: 0.037636 Nov 28 00:45:13 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:13 2023] GET /compute/v2.1/servers/b8080c31-0df3-44ba-8586-b1ca39d9c97e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 00:45:14 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-deleted", "tag": "734679ea-803f-454c-ad23-ed3bbd4951e5"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] Creating event network-vif-deleted:734679ea-803f-454c-ad23-ed3bbd4951e5 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:45:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-4c4d8448-4295-4c87-bc38-1afd948c78be req-793600dd-a8a2-40cf-a8d4-6465e3ae9ada service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053737 Nov 28 00:45:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 80/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86575409-89de-4408-a573-d069767ebb15", "name": "network-vif-plugged", "status": "completed", "tag": "734679ea-803f-454c-ad23-ed3bbd4951e5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] Creating event network-vif-plugged:734679ea-803f-454c-ad23-ed3bbd4951e5 for instance 86575409-89de-4408-a573-d069767ebb15 on user Nov 28 00:45:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-cf5caae0-d619-4880-b74e-6863df798e5d req-5d1638ff-e25e-4f01-89ac-165c08238d20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057141 Nov 28 00:45:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 87/251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:17 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:17 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] Creating event network-changed:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:45:17 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-04b4d673-3b37-4d1a-8c52-91a2fe0f29a0 req-bea02f0f-25af-424a-a148-f025e51472a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030881 Nov 28 00:45:17 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 85/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:45:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-25621776-a7f0-40a7-9069-0553eef40d32 req-c65e8076-cc43-4410-af8f-83e570b16d3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041327 Nov 28 00:45:17 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 81/253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:45:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-f584f7fc-4412-4838-b917-80930d649f26 req-01651034-b141-4240-8414-30e2aa8def8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039402 Nov 28 00:45:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 88/254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:20 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4185a646-8bff-4f0b-972f-f3eb43c557ba tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049784 Nov 28 00:45:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 86/255] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:45:20 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:20 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:45:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d37981df-651e-4607-b228-5daf208df62b tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24" status: 204 len: 0 microversion: 2.1 time: 0.391663 Nov 28 00:45:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 82/256] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:45:20 2023] DELETE /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:20 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4107c4de40db41478617a3e7740cdaf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfcf25cb4d7643beaf41d08d65c37c76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6d4f1235-bbb5-4901-8160-a19f90d49950 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24" status: 200 len: 1643 microversion: 2.1 time: 0.280008 Nov 28 00:45:20 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 89/257] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:20 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24 => generated 1643 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:45:21 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fb5677-018f-4e32-b945-166600ec6a24", "name": "network-vif-unplugged", "status": "completed", "tag": "d958f7e8-8730-4756-8515-ce61c1d1efce"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] Creating event network-vif-unplugged:d958f7e8-8730-4756-8515-ce61c1d1efce for instance 46fb5677-018f-4e32-b945-166600ec6a24 on user Nov 28 00:45:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5a49f864-388a-465b-b626-11eb801b8a6d req-dd98e398-082a-41a9-af58-56380cc67e9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029870 Nov 28 00:45:21 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 87/258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fb5677-018f-4e32-b945-166600ec6a24", "name": "network-vif-deleted", "tag": "d958f7e8-8730-4756-8515-ce61c1d1efce"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] Creating event network-vif-deleted:d958f7e8-8730-4756-8515-ce61c1d1efce for instance 46fb5677-018f-4e32-b945-166600ec6a24 on user Nov 28 00:45:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-fbf6590b-22f6-4639-b92f-129b15de5a27 req-eeed8984-3505-4755-9e2a-1252ab0969d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038952 Nov 28 00:45:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 83/259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1413117774", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1"}]}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:22 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] validate_networks() for [('0ce73ad0-6ff4-422c-91dd-e52e37370fe1', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46fb5677-018f-4e32-b945-166600ec6a24", "name": "network-vif-plugged", "status": "completed", "tag": "d958f7e8-8730-4756-8515-ce61c1d1efce"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] Creating event network-vif-plugged:d958f7e8-8730-4756-8515-ce61c1d1efce for instance 46fb5677-018f-4e32-b945-166600ec6a24 on user Nov 28 00:45:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5dd6fc25-b06d-4fe7-9e3c-f13eff6eb400 req-2b92587f-df53-438b-946a-7137dca0bf71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036753 Nov 28 00:45:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 88/260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting quotas for project 576886774b2943b999ec92134d8065b4. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting quotas for user 8aa0d095400943e28234a9f476ea0a4f and project 576886774b2943b999ec92134d8065b4. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:45:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b140501c-e4a2-4d22-8c28-46054f0f90b5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.932299 Nov 28 00:45:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 90/261] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 00:45:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:45:23 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c3c025f5-ebe3-4830-8ddc-bf0abdadfaa3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:23 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c3c025f5-ebe3-4830-8ddc-bf0abdadfaa3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:23 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-c3c025f5-ebe3-4830-8ddc-bf0abdadfaa3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:23 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-c3c025f5-ebe3-4830-8ddc-bf0abdadfaa3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:23 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-c3c025f5-ebe3-4830-8ddc-bf0abdadfaa3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:23 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c3c025f5-ebe3-4830-8ddc-bf0abdadfaa3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 200 len: 1395 microversion: 2.87 time: 0.092372 Nov 28 00:45:23 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 84/262] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:45:23 2023] GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 1395 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:23 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Going to try to start instance {{(pid=65277) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 28 00:45:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-034bef5c-5476-415a-acf4-d9df2f30bfa6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/action" status: 202 len: 0 microversion: 2.1 time: 0.112888 Nov 28 00:45:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 89/263] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:45:23 2023] POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:24 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c8b16b44-1b45-46e4-8269-7539918a3a3e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1694 microversion: 2.1 time: 0.262390 Nov 28 00:45:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 91/264] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:23 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1694 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:45:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] Creating event network-changed:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:45:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-56d28bf1-5afe-4555-a553-9f8fc3834bd0 req-099dca1a-3696-481f-bcde-f75fdaf60975 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045914 Nov 28 00:45:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 85/265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] HTTP exception thrown: Instance 51a4dd5e-3313-4c04-a699-9184465e9895 could not be found. Nov 28 00:45:26 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Returning 404 to user: Instance 51a4dd5e-3313-4c04-a699-9184465e9895 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:45:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-95d0eb4c-aaed-4045-8454-aebaa9e78fd4 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895" status: 404 len: 111 microversion: 2.32 time: 0.037367 Nov 28 00:45:26 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 90/266] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:45:26 2023] GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:45:26 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-135e9287-99c5-4239-b7b3-adf1d30a949c tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '.version_select at 0x7f497335e320>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:26 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-135e9287-99c5-4239-b7b3-adf1d30a949c tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-452999819" status: 204 len: 0 microversion: 2.32 time: 0.028840 Nov 28 00:45:26 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 92/267] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 00:45:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-452999819 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:45:29 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:29 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:45:29 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-f0c32cef-ab13-48fd-b823-742f4c759724 req-721436ae-fc4f-4e04-9ae4-4faad967d7f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044654 Nov 28 00:45:29 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 86/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] HTTP exception thrown: Instance 51a4dd5e-3313-4c04-a699-9184465e9895 could not be found. Nov 28 00:45:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Returning 404 to user: Instance 51a4dd5e-3313-4c04-a699-9184465e9895 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:45:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-db47f9d4-511e-4b6a-8261-44abf9f9c879 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895" status: 404 len: 111 microversion: 2.32 time: 0.048193 Nov 28 00:45:30 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 91/269] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:45:30 2023] DELETE /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:45:30 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:30 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] [instance: 51a4dd5e-3313-4c04-a699-9184465e9895] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:31 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] HTTP exception thrown: Instance 51a4dd5e-3313-4c04-a699-9184465e9895 could not be found. Nov 28 00:45:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] Returning 404 to user: Instance 51a4dd5e-3313-4c04-a699-9184465e9895 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:45:31 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-9ef9b158-ea19-4812-9438-94e10e9085e5 tempest-TaggedBootDevicesTest-2102994287 tempest-TaggedBootDevicesTest-2102994287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895" status: 404 len: 111 microversion: 2.32 time: 0.127514 Nov 28 00:45:31 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 93/270] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:45:30 2023] GET /compute/v2.1/servers/51a4dd5e-3313-4c04-a699-9184465e9895 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:45:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:45:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-9e07845c-9603-4c0e-8c92-bbf5cb6569a7 req-d6eaf329-c8ff-424c-aee4-70ffd7f8d99d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049079 Nov 28 00:45:31 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 87/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:34 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6657488fa71b469c954276af7717308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1afcbb4b3643c5ae366c8e39f3d8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:45:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e3de8a9b-350e-406d-aabb-5c0de3c1b782 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3" status: 200 len: 1494 microversion: 2.1 time: 0.331237 Nov 28 00:45:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 92/272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:34 2023] GET /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3 => generated 1494 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:45:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:44 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:44 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:44 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:44 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:45:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-c68acc69-607f-41c0-852b-29201f836a87 req-1d8925d2-e5a2-467c-af32-1853266c89f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047217 Nov 28 00:45:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 94/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:46 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:46 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:46 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:45:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:45:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-130b67a3-732a-48b1-a07b-c4e69c60f765 req-df0cdec6-fdd6-40c8-84ae-670f2fa022b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047905 Nov 28 00:45:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 88/274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] [instance: fdea5f7d-ce77-4c66-afac-ddc24baeabd9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] HTTP exception thrown: Instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 could not be found. Nov 28 00:45:49 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Returning 404 to user: Instance fdea5f7d-ce77-4c66-afac-ddc24baeabd9 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:45:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-b01d2cc2-253f-4456-8961-d43945c34dac tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9" status: 404 len: 111 microversion: 2.1 time: 0.031669 Nov 28 00:45:49 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 93/275] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:49 2023] GET /compute/v2.1/servers/fdea5f7d-ce77-4c66-afac-ddc24baeabd9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:45:49 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-150cf442-068f-4ca8-ae73-d01f70442c30 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] Calling method '.version_select at 0x7f497335e9e0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:49 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-150cf442-068f-4ca8-ae73-d01f70442c30 tempest-VolumesAssistedSnapshotsTest-1497464835 tempest-VolumesAssistedSnapshotsTest-1497464835-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-120630317" status: 202 len: 0 microversion: 2.1 time: 0.024408 Nov 28 00:45:49 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 95/276] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 00:45:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-120630317 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] [instance: cd2dca4b-65fc-4db5-a4f0-60d592d1a4db] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:45:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] HTTP exception thrown: Instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db could not be found. Nov 28 00:45:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] Returning 404 to user: Instance cd2dca4b-65fc-4db5-a4f0-60d592d1a4db could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:45:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f078dbb2-815c-499d-bebd-a3d2b9386555 tempest-VolumesNegativeTest-493175275 tempest-VolumesNegativeTest-493175275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db" status: 404 len: 111 microversion: 2.1 time: 0.038575 Nov 28 00:45:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 89/277] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:45:51 2023] GET /compute/v2.1/servers/cd2dca4b-65fc-4db5-a4f0-60d592d1a4db => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:45:59 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:45:59 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6dddd058-d5f5-41ed-bebc-0751d824770b tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Action: 'create', calling method: .version_select at 0x7f49733776d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-685761312"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6dddd058-d5f5-41ed-bebc-0751d824770b tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.525583 Nov 28 00:46:00 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 94/278] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Nov 28 00:45:59 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 527 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 28 00:46:00 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:00 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d38b336c-069d-4b23-88e0-8f7c6ea27b4b tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973275fc0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-d38b336c-069d-4b23-88e0-8f7c6ea27b4b tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 200 len: 344 microversion: 2.1 time: 0.087375 Nov 28 00:46:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 96/279] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:00 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:01 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:01 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b7203610-8a7b-45d8-8aa8-74a9d69af15e tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f49730611b0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b7203610-8a7b-45d8-8aa8-74a9d69af15e tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 200 len: 344 microversion: 2.1 time: 0.061288 Nov 28 00:46:01 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 90/280] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:01 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:01 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-41c87207-8f2e-41e5-8ba9-f8e1d6591107 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046279 Nov 28 00:46:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:46:01 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] HTTP exception thrown: Instance 2619f610-3a3c-4b48-9448-c30d75414e56 is not attached to volume 690a2933-f2cc-4d04-b41a-41189277b740 Nov 28 00:46:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Returning 404 to user: Instance 2619f610-3a3c-4b48-9448-c30d75414e56 is not attached to volume 690a2933-f2cc-4d04-b41a-41189277b740 {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a20508c5-b45c-4a2a-a2e3-a1d0c6feb373 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments/690a2933-f2cc-4d04-b41a-41189277b740" status: 404 len: 154 microversion: 2.1 time: 0.098599 Nov 28 00:46:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 97/282] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:46:01 2023] DELETE /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56/os-volume_attachments/690a2933-f2cc-4d04-b41a-41189277b740 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:02 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-fd7806be-5f41-4b42-8f96-678ce2bc98f5 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973376e60>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-fd7806be-5f41-4b42-8f96-678ce2bc98f5 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 200 len: 345 microversion: 2.1 time: 0.059109 Nov 28 00:46:02 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 96/283] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:02 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:02 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f5ff4314-8b45-4a84-aae7-3b3584eba6b6 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Action: 'create', calling method: .version_select at 0x7f497335f6d0>, body: {"snapshot": {"volume_id": "b71859e4-8448-4abf-9836-5566fdae3e3d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1999795521"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f5ff4314-8b45-4a84-aae7-3b3584eba6b6 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.332047 Nov 28 00:46:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 98/284] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Nov 28 00:46:02 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6133cc99-a0a6-4ac2-813b-a53bf025c520 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973276b00>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:03 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-a3451961-0678-44ff-8cb5-fd27e87f2c8d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 200 len: 1543 microversion: 2.1 time: 0.640731 Nov 28 00:46:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 91/285] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:02 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 1543 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:46:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] HTTP exception thrown: Instance 86575409-89de-4408-a573-d069767ebb15 could not be found. Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Returning 404 to user: Instance 86575409-89de-4408-a573-d069767ebb15 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-72e411c0-f05f-4f22-872d-4c3c9e61ca71 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15" status: 404 len: 111 microversion: 2.49 time: 0.048857 Nov 28 00:46:03 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 97/286] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:46:03 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:46:03 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e115dae5-dc8e-4e57-95a9-94ca1c4441db tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '.version_select at 0x7f49732a4040>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6133cc99-a0a6-4ac2-813b-a53bf025c520 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 200 len: 287 microversion: 2.1 time: 0.067340 Nov 28 00:46:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 99/287] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:03 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:46:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e115dae5-dc8e-4e57-95a9-94ca1c4441db tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061836304" status: 204 len: 0 microversion: 2.49 time: 0.033767 Nov 28 00:46:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 92/288] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 00:46:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061836304 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:46:03 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d29bfae5-e4df-42df-98d9-53600dad6fd0 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973377400>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d29bfae5-e4df-42df-98d9-53600dad6fd0 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.051662 Nov 28 00:46:03 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 98/289] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 28 00:46:03 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9bd901ae-ce95-4d4b-804e-cac2d5e79572 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f497357ba30>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-9bd901ae-ce95-4d4b-804e-cac2d5e79572 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 200 len: 287 microversion: 2.1 time: 0.123993 Nov 28 00:46:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 100/290] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:03 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:04 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-acdeee57-c905-413c-8f7a-1888e283fe56 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973061b40>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:04 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-acdeee57-c905-413c-8f7a-1888e283fe56 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 200 len: 287 microversion: 2.1 time: 0.038355 Nov 28 00:46:04 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 93/291] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:04 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] HTTP exception thrown: Instance 86575409-89de-4408-a573-d069767ebb15 could not be found. Nov 28 00:46:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Returning 404 to user: Instance 86575409-89de-4408-a573-d069767ebb15 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0475b3b5-d761-4071-940e-7a2e2acb8556 tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15" status: 404 len: 111 microversion: 2.49 time: 0.029553 Nov 28 00:46:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 99/292] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:46:04 2023] DELETE /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] [instance: 86575409-89de-4408-a573-d069767ebb15] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:04 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] HTTP exception thrown: Instance 86575409-89de-4408-a573-d069767ebb15 could not be found. Nov 28 00:46:04 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] Returning 404 to user: Instance 86575409-89de-4408-a573-d069767ebb15 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:04 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0c55e850-5951-4756-a395-29c0cc02b79d tempest-TaggedAttachmentsTest-787925865 tempest-TaggedAttachmentsTest-787925865-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15" status: 404 len: 111 microversion: 2.49 time: 0.035718 Nov 28 00:46:04 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 101/293] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:46:04 2023] GET /compute/v2.1/servers/86575409-89de-4408-a573-d069767ebb15 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:46:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b80a8946-9985-4f29-866d-6d6889ff1211 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973062440>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b80a8946-9985-4f29-866d-6d6889ff1211 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 200 len: 287 microversion: 2.1 time: 0.044158 Nov 28 00:46:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 94/294] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:05 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-33f36dd9-9235-4f3c-a8e6-39e56c13f07d tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f497335fd00>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-33f36dd9-9235-4f3c-a8e6-39e56c13f07d tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 200 len: 288 microversion: 2.1 time: 0.055907 Nov 28 00:46:06 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 102/295] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:06 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 288 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b72bea4e-bf26-4e86-9733-95f023befc63 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f49732a6a70>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c4876b0d-0429-4a00-ae0c-255d2e824bb1 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56" status: 204 len: 0 microversion: 2.1 time: 0.144974 Nov 28 00:46:06 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:46:06 2023] DELETE /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b72bea4e-bf26-4e86-9733-95f023befc63 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 202 len: 0 microversion: 2.1 time: 0.085028 Nov 28 00:46:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 95/297] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 28 00:46:06 2023] DELETE /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:46:06 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1821b7e3-fb5e-476d-954c-3f1551289948 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973465120>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1821b7e3-fb5e-476d-954c-3f1551289948 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 200 len: 287 microversion: 2.1 time: 0.062585 Nov 28 00:46:06 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 101/298] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:06 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:06 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6f5f016eeb4e1fbb54d8b4163a1e69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a97779a519d04d8bb60a0dfcfd23f347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-cdb0e9db-0c83-4ec9-94c2-030b4ebecbe0 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56" status: 200 len: 1699 microversion: 2.1 time: 0.266360 Nov 28 00:46:06 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 103/299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:06 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56 => generated 1699 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:46:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2619f610-3a3c-4b48-9448-c30d75414e56", "name": "network-vif-unplugged", "status": "completed", "tag": "8482d7a1-9b99-461b-aff7-9748c14d2529"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] Creating event network-vif-unplugged:8482d7a1-9b99-461b-aff7-9748c14d2529 for instance 2619f610-3a3c-4b48-9448-c30d75414e56 on user Nov 28 00:46:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-567493fa-6642-441f-961b-78a140a8c398 req-e4769b51-d7db-41c0-ba94-cb80e8b4491b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066996 Nov 28 00:46:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 96/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-bd47b119-d24a-4397-bd98-edefc1d6dd96 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f49732becb0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-bd47b119-d24a-4397-bd98-edefc1d6dd96 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 200 len: 287 microversion: 2.1 time: 0.475477 Nov 28 00:46:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 102/301] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:07 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 287 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2619f610-3a3c-4b48-9448-c30d75414e56", "name": "network-vif-plugged", "status": "completed", "tag": "8482d7a1-9b99-461b-aff7-9748c14d2529"}, {"server_uuid": "2619f610-3a3c-4b48-9448-c30d75414e56", "name": "network-vif-deleted", "tag": "8482d7a1-9b99-461b-aff7-9748c14d2529"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Creating event network-vif-plugged:8482d7a1-9b99-461b-aff7-9748c14d2529 for instance 2619f610-3a3c-4b48-9448-c30d75414e56 on user Nov 28 00:46:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] Creating event network-vif-deleted:8482d7a1-9b99-461b-aff7-9748c14d2529 for instance 2619f610-3a3c-4b48-9448-c30d75414e56 on user Nov 28 00:46:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-9303d087-e3d4-4d65-92e0-144dbf022efb req-85e0eaed-a729-4eea-bc0f-692b74c16127 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063119 Nov 28 00:46:08 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 104/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:46:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-6eb6438e-d6ff-4a88-baa4-fc31f3f3a4d6 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f497314a170>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-6eb6438e-d6ff-4a88-baa4-fc31f3f3a4d6 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 200 len: 287 microversion: 2.1 time: 0.145354 Nov 28 00:46:09 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 97/303] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:09 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-37872085-e230-4425-938c-21afcf9882c5 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f49732bfbe0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-37872085-e230-4425-938c-21afcf9882c5 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] HTTP exception thrown: Snapshot a6a53dad-b672-41bf-8673-31443f29a5b8 could not be found. Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-37872085-e230-4425-938c-21afcf9882c5 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Returning 404 to user: Snapshot a6a53dad-b672-41bf-8673-31443f29a5b8 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-37872085-e230-4425-938c-21afcf9882c5 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8" status: 404 len: 111 microversion: 2.1 time: 0.039726 Nov 28 00:46:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 103/304] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 00:46:10 2023] GET /compute/v2.1/os-snapshots/a6a53dad-b672-41bf-8673-31443f29a5b8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9d8ccd8d-222f-4535-b09e-03b2cb7b2c59 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f497335c430>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-9d8ccd8d-222f-4535-b09e-03b2cb7b2c59 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 202 len: 0 microversion: 2.1 time: 0.070111 Nov 28 00:46:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 105/305] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 00:46:10 2023] DELETE /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:46:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e275edf0-0f25-4131-90e1-a891c575b82d tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f49730620e0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e275edf0-0f25-4131-90e1-a891c575b82d tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 200 len: 344 microversion: 2.1 time: 0.053079 Nov 28 00:46:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 98/306] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:10 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:10 user devstack@n-api.service[65277]: DEBUG nova.objects.instance [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'flavor' on Instance uuid bf245d26-e901-4fca-8ff5-a3558974294b {{(pid=65277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] [instance: 46fb5677-018f-4e32-b945-166600ec6a24] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:11 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-f88334e7-414c-4d8e-9527-f5e96b9fa736 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b/action" status: 200 len: 32 microversion: 2.1 time: 0.162518 Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:11 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 104/307] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:46:10 2023] POST /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] HTTP exception thrown: Instance 46fb5677-018f-4e32-b945-166600ec6a24 could not be found. Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Returning 404 to user: Instance 46fb5677-018f-4e32-b945-166600ec6a24 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-36c68937-14d6-4774-be95-4cfb5ca07d13 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24" status: 404 len: 111 microversion: 2.1 time: 0.070777 Nov 28 00:46:11 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 106/308] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:11 2023] GET /compute/v2.1/servers/46fb5677-018f-4e32-b945-166600ec6a24 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:11 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-222b3586-6a31-4032-b5f4-b80369168725 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] Calling method '.version_select at 0x7f4973466c20>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:11 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-222b3586-6a31-4032-b5f4-b80369168725 tempest-TestVolumeSwap-792541960 tempest-TestVolumeSwap-792541960-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-7931677" status: 202 len: 0 microversion: 2.1 time: 0.035830 Nov 28 00:46:11 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 105/309] 10.0.0.210 () {62 vars in 1289 bytes} [Tue Nov 28 00:46:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-7931677 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:46:11 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c5713ba0-d20a-445d-9e49-7948e4dd17d4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 200 len: 1508 microversion: 2.1 time: 0.345199 Nov 28 00:46:11 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 99/310] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:11 2023] GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:46:11 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-88e9cbd1-a03a-4890-9f7d-900132e7c0ca tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f497335fd90>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-88e9cbd1-a03a-4890-9f7d-900132e7c0ca tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 200 len: 344 microversion: 2.1 time: 0.059455 Nov 28 00:46:11 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 107/311] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:11 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-164256632", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "f7c0059b-8a32-43e9-8aee-01936933e250"}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] validate_networks() for [('f7c0059b-8a32-43e9-8aee-01936933e250', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:46:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-unplugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] Creating event network-vif-unplugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:46:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-3f68736d-a8ca-4807-9288-60aa924079f1 req-325780ad-1ee3-4c0d-b1d9-59bd594b0b0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057720 Nov 28 00:46:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 100/312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:12 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7d4be3a6-39e2-421a-8e5b-b59bb719fe20 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f497335c430>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Getting quotas for project 3e19068366934d7db3a2cb3131af5498. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Getting quotas for user b8dd53f8dd874658a31a1aaf40a4091e and project 3e19068366934d7db3a2cb3131af5498. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:46:12 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7d4be3a6-39e2-421a-8e5b-b59bb719fe20 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 200 len: 344 microversion: 2.1 time: 0.071568 Nov 28 00:46:12 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 108/313] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:12 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:46:12 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:46:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-cfa5965b-24d6-41b6-aabb-a8f2c4eb8691 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.854720 Nov 28 00:46:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 106/314] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:46:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:46:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c146ae96-0316-409e-bee0-69f2407339be tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:12 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c146ae96-0316-409e-bee0-69f2407339be tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:12 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-c146ae96-0316-409e-bee0-69f2407339be tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8dd53f8dd874658a31a1aaf40a4091e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e19068366934d7db3a2cb3131af5498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c146ae96-0316-409e-bee0-69f2407339be tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b" status: 200 len: 1206 microversion: 2.1 time: 0.101769 Nov 28 00:46:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 101/315] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:12 2023] GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b => generated 1206 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:46:13 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a3311412-6228-45e9-8b61-58ac175d801a tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973275bd0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:13 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a3311412-6228-45e9-8b61-58ac175d801a tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 200 len: 344 microversion: 2.1 time: 0.067383 Nov 28 00:46:13 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 109/316] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:13 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:13 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:13 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:14 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:14 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:14 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e57f5057-4153-4489-b3be-0c7f6c5a5280 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 200 len: 1769 microversion: 2.87 time: 0.373317 Nov 28 00:46:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 107/317] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:46:13 2023] GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 1769 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-unplugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:46:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:46:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:46:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Creating event network-vif-unplugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:46:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:46:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-85cac472-1659-4c1d-8641-3a63a4daf7ca req-f4cf6f33-9a5a-420f-b66c-1d4d671c8c94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.187806 Nov 28 00:46:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 110/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:14 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:14 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3c5c2cbc-b9e4-4500-a3e8-bbdf2411381c tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973376cb0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1e579d01-c2ab-4a51-8b49-f2a8cb0ab9a9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1698 microversion: 2.1 time: 0.498395 Nov 28 00:46:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 102/319] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:14 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1698 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:46:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-3c5c2cbc-b9e4-4500-a3e8-bbdf2411381c tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 200 len: 344 microversion: 2.1 time: 0.096219 Nov 28 00:46:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:14 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-eaa2fd7d-b3c1-4ff1-961f-df87196dde5b tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f497335fb50>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-eaa2fd7d-b3c1-4ff1-961f-df87196dde5b tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] HTTP exception thrown: Volume b71859e4-8448-4abf-9836-5566fdae3e3d could not be found. Nov 28 00:46:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-eaa2fd7d-b3c1-4ff1-961f-df87196dde5b tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Returning 404 to user: Volume b71859e4-8448-4abf-9836-5566fdae3e3d could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-eaa2fd7d-b3c1-4ff1-961f-df87196dde5b tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 404 len: 109 microversion: 2.1 time: 0.044313 Nov 28 00:46:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 111/321] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:15 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-de75ebc4-074e-4d74-b10c-738fc0d447f7 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f49735ef880>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-de75ebc4-074e-4d74-b10c-738fc0d447f7 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] HTTP exception thrown: Volume b71859e4-8448-4abf-9836-5566fdae3e3d could not be found. Nov 28 00:46:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-de75ebc4-074e-4d74-b10c-738fc0d447f7 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Returning 404 to user: Volume b71859e4-8448-4abf-9836-5566fdae3e3d could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-de75ebc4-074e-4d74-b10c-738fc0d447f7 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 404 len: 109 microversion: 2.1 time: 0.061441 Nov 28 00:46:15 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 103/322] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 00:46:15 2023] DELETE /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:15 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-22c685f6-031c-406e-91f3-7e607bdba2a6 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Calling method '.version_select at 0x7f4973377f40>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-22c685f6-031c-406e-91f3-7e607bdba2a6 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] HTTP exception thrown: Volume b71859e4-8448-4abf-9836-5566fdae3e3d could not be found. Nov 28 00:46:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-22c685f6-031c-406e-91f3-7e607bdba2a6 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] Returning 404 to user: Volume b71859e4-8448-4abf-9836-5566fdae3e3d could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-22c685f6-031c-406e-91f3-7e607bdba2a6 tempest-VolumesSnapshotsTestJSON-1559508321 tempest-VolumesSnapshotsTestJSON-1559508321-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d" status: 404 len: 109 microversion: 2.1 time: 0.036237 Nov 28 00:46:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:15 2023] GET /compute/v2.1/os-volumes/b71859e4-8448-4abf-9836-5566fdae3e3d => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"name": "network-changed", "server_uuid": "c8307b4a-ad04-4830-9752-5157af5a4f3b", "tag": "79f0240f-a11e-4733-adaa-4a5f4b2ae450"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:46:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:46:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] Creating event network-changed:79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance c8307b4a-ad04-4830-9752-5157af5a4f3b on user Nov 28 00:46:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-5e9647f2-7b0f-4d22-b4bc-33511825517b req-177bdfea-1edb-47c1-9e01-36800a709472 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.046471 Nov 28 00:46:16 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 112/324] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2b87ed69-ee3c-43cc-9fe4-4f4031f1c12c tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Action: 'create', calling method: .version_select at 0x7f4974031d80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-99570287", "metadata": {"Type": "work"}}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2b87ed69-ee3c-43cc-9fe4-4f4031f1c12c tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2b87ed69-ee3c-43cc-9fe4-4f4031f1c12c tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.524333 Nov 28 00:46:18 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 104/325] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 00:46:18 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 526 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 28 00:46:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-50c65d51-ca45-4305-bdef-e4ce65cf82e7 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Action: 'create', calling method: .version_select at 0x7f497341bd00>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2091948659", "metadata": {"Type": "work"}}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-50c65d51-ca45-4305-bdef-e4ce65cf82e7 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-50c65d51-ca45-4305-bdef-e4ce65cf82e7 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016178 Nov 28 00:46:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 110/326] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 00:46:18 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:46:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0ab31014-dc64-45b8-b3ef-cf7ea2eb2d14 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Action: 'create', calling method: .version_select at 0x7f497335d1b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1133849509", "metadata": {"Type": "work"}}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0ab31014-dc64-45b8-b3ef-cf7ea2eb2d14 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0ab31014-dc64-45b8-b3ef-cf7ea2eb2d14 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007782 Nov 28 00:46:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 113/327] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 00:46:18 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:46:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4863a6c6-1b89-4f71-a167-6739ecfb6bd5 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Calling method '.version_select at 0x7f4973149090>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-4863a6c6-1b89-4f71-a167-6739ecfb6bd5 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] HTTP exception thrown: Volume tempest-invalid-803390613 could not be found. Nov 28 00:46:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4863a6c6-1b89-4f71-a167-6739ecfb6bd5 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Returning 404 to user: Volume tempest-invalid-803390613 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-4863a6c6-1b89-4f71-a167-6739ecfb6bd5 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-803390613" status: 404 len: 98 microversion: 2.1 time: 0.049613 Nov 28 00:46:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 105/328] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 28 00:46:18 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-803390613 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 28 00:46:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-955f3024-aa1d-4e00-872f-658556b7d53f tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003562 Nov 28 00:46:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 111/329] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 28 00:46:19 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 28 00:46:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-050aaa8b-9c5d-4902-8362-4f447186d2fb tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005319 Nov 28 00:46:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 114/330] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Nov 28 00:46:19 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 28 00:46:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-25a58eec-cdd8-4392-9792-7a8a80c0f01c tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Calling method '.version_select at 0x7f49734669e0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-25a58eec-cdd8-4392-9792-7a8a80c0f01c tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] HTTP exception thrown: Volume 00879ccc-0147-4d10-9c24-e183442aac0a could not be found. Nov 28 00:46:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-25a58eec-cdd8-4392-9792-7a8a80c0f01c tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Returning 404 to user: Volume 00879ccc-0147-4d10-9c24-e183442aac0a could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-25a58eec-cdd8-4392-9792-7a8a80c0f01c tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/00879ccc-0147-4d10-9c24-e183442aac0a" status: 404 len: 109 microversion: 2.1 time: 0.053788 Nov 28 00:46:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 106/331] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 00:46:19 2023] DELETE /compute/v2.1/os-volumes/00879ccc-0147-4d10-9c24-e183442aac0a => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:19 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8307b4a-ad04-4830-9752-5157af5a4f3b", "name": "network-vif-plugged", "status": "completed", "tag": "79f0240f-a11e-4733-adaa-4a5f4b2ae450"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c18eb0ca-3f66-44ff-9d95-dd3e70cdbc96 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Calling method '.version_select at 0x7f4973275480>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] Creating event network-vif-plugged:79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance c8307b4a-ad04-4830-9752-5157af5a4f3b on user Nov 28 00:46:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-af6dd1a9-edcf-4248-a940-787277215a72 req-5099c756-c458-40ff-8d5f-57addd7c490d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062543 Nov 28 00:46:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 112/332] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-c18eb0ca-3f66-44ff-9d95-dd3e70cdbc96 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] HTTP exception thrown: Volume f20f82db-9396-49ec-83a8-0899e81e2a42 could not be found. Nov 28 00:46:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c18eb0ca-3f66-44ff-9d95-dd3e70cdbc96 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] Returning 404 to user: Volume f20f82db-9396-49ec-83a8-0899e81e2a42 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c18eb0ca-3f66-44ff-9d95-dd3e70cdbc96 tempest-VolumesNegativeTest-1630772240 tempest-VolumesNegativeTest-1630772240-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f20f82db-9396-49ec-83a8-0899e81e2a42" status: 404 len: 109 microversion: 2.1 time: 0.075322 Nov 28 00:46:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 115/333] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 00:46:19 2023] GET /compute/v2.1/os-volumes/f20f82db-9396-49ec-83a8-0899e81e2a42 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:21 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8307b4a-ad04-4830-9752-5157af5a4f3b", "name": "network-vif-plugged", "status": "completed", "tag": "79f0240f-a11e-4733-adaa-4a5f4b2ae450"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:21 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] Creating event network-vif-plugged:79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance c8307b4a-ad04-4830-9752-5157af5a4f3b on user Nov 28 00:46:21 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-e6119790-04cd-4eaa-9161-085e8fe83320 req-e2a58001-e4a8-4eaa-a614-5c73a28ee53b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074838 Nov 28 00:46:21 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 107/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6755375c-d4fd-4b9d-b33c-260efdc7e40c"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] HTTP exception thrown: Volume 48980916-f20d-472e-947b-be1381255429 could not be found. Nov 28 00:46:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] Returning 404 to user: Volume 48980916-f20d-472e-947b-be1381255429 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-46baf87e-b0a3-44ab-a60b-d61e1a01925e tempest-VolumesAdminNegativeTest-350958831 tempest-VolumesAdminNegativeTest-350958831-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3/os-volume_attachments/48980916-f20d-472e-947b-be1381255429" status: 404 len: 109 microversion: 2.1 time: 0.328600 Nov 28 00:46:37 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 113/335] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 00:46:37 2023] PUT /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3/os-volume_attachments/48980916-f20d-472e-947b-be1381255429 => generated 109 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=14 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=22 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:42 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:46:42 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fca2c518-572e-4d0e-ad7b-854ec64c9053 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3" status: 204 len: 0 microversion: 2.1 time: 0.147284 Nov 28 00:46:42 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 116/336] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:46:42 2023] DELETE /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=24 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:43 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6657488fa71b469c954276af7717308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1afcbb4b3643c5ae366c8e39f3d8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-95894e76-c9eb-4acc-a423-92e0cc8c5f6c tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3" status: 200 len: 1500 microversion: 2.1 time: 0.682265 Nov 28 00:46:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 108/337] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:42 2023] GET /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3 => generated 1500 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:46:43 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-60013c14-eefc-4d93-8cf5-6d568830f4a4 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Action: 'create', calling method: .version_select at 0x7f4974947010>, body: {"keypair": {"name": "tempest-keypair-1863538692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeLeFyui7EtEAWqHdB6manqN9vr/X782IxHla6S0t04UCJLZtQ2oUVSYWwggB+cr7iwI83ih0eJAR1KpLnQ2WNSVyL0EPYKc3HFQM1szSXbIOGDeHwQqYaJvAydx8J3dg=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:43 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-60013c14-eefc-4d93-8cf5-6d568830f4a4 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting quotas for project b57f21cfce3044c5aad7192a64ce2d8a. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:46:43 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-60013c14-eefc-4d93-8cf5-6d568830f4a4 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting quotas for user e626332697e34a0ba733c723a5ecb328 and project b57f21cfce3044c5aad7192a64ce2d8a. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:46:43 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-60013c14-eefc-4d93-8cf5-6d568830f4a4 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122533 Nov 28 00:46:43 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 114/338] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:46:43 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-f290a868-92d9-42fc-9bce-362b357acdfd req-b6119212-1b23-4bf0-8455-2531d52affcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e00566-f7d4-4022-9377-94fcb8f54fd3", "name": "network-vif-deleted", "tag": "09f3cea2-142d-4c24-8c21-27880492615b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f290a868-92d9-42fc-9bce-362b357acdfd req-b6119212-1b23-4bf0-8455-2531d52affcd service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f290a868-92d9-42fc-9bce-362b357acdfd req-b6119212-1b23-4bf0-8455-2531d52affcd service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f290a868-92d9-42fc-9bce-362b357acdfd req-b6119212-1b23-4bf0-8455-2531d52affcd service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-f290a868-92d9-42fc-9bce-362b357acdfd req-b6119212-1b23-4bf0-8455-2531d52affcd service nova] Creating event network-vif-deleted:09f3cea2-142d-4c24-8c21-27880492615b for instance d9e00566-f7d4-4022-9377-94fcb8f54fd3 on user Nov 28 00:46:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-f290a868-92d9-42fc-9bce-362b357acdfd req-b6119212-1b23-4bf0-8455-2531d52affcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110603 Nov 28 00:46:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 117/339] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7e5363bb-3786-4bb1-9483-7e830092222e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Action: 'create', calling method: .version_select at 0x7f49732a6a70>, body: {"keypair": {"name": "tempest-keypair-213731965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQT93B1uIu5X8ATFza/6QgBPFdK/6Mj2vlay+fJdO/NuBhwWV8F2g3oDnIf2Cvqh9Pygmd8ZgZE5MRMhTiHjAmoHx0hy5rIBY0Xs3DmMePM0qt2SWEAhGwI0quO8mHUaA=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:46 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-7e5363bb-3786-4bb1-9483-7e830092222e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting quotas for project 68ab8531e1e740798cff8ce9dd2cb311. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:46:46 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-7e5363bb-3786-4bb1-9483-7e830092222e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting quotas for user a4a78fd7893c4c17acd06b280542b631 and project 68ab8531e1e740798cff8ce9dd2cb311. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:46:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-7e5363bb-3786-4bb1-9483-7e830092222e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.197745 Nov 28 00:46:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 109/340] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:46:45 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:47 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:47 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherB-server-1577106707", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e01edb42-6b5b-4b41-af5f-489ab4269136"}], "security_groups": [{"name": "tempest-securitygroup--1813525778"}], "key_name": "tempest-keypair-1863538692", "user_data": "}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:47 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] validate_networks() for [('e01edb42-6b5b-4b41-af5f-489ab4269136', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting quotas for project b57f21cfce3044c5aad7192a64ce2d8a. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting quotas for user e626332697e34a0ba733c723a5ecb328 and project b57f21cfce3044c5aad7192a64ce2d8a. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:46:48 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:46:48 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d06a6cfc-1ad3-433e-a991-67a4261f6f75 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.006332 Nov 28 00:46:48 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 115/341] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:46:47 2023] POST /compute/v2.1/servers => generated 407 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:46:48 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0666c76e-5250-4ba5-9d5a-eb2597f4e2cf tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:48 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-0666c76e-5250-4ba5-9d5a-eb2597f4e2cf tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:48 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-0666c76e-5250-4ba5-9d5a-eb2597f4e2cf tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:48 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0666c76e-5250-4ba5-9d5a-eb2597f4e2cf tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1233 microversion: 2.1 time: 0.199230 Nov 28 00:46:48 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 118/342] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:48 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1233 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:46:49 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-159767708", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "key_name": "tempest-keypair-213731965", "security_groups": [{"name": "tempest-secgroup-smoke-128366375"}, {"name": "tempest-securitygroup--976965905"}], "networks": [{"uuid": "975a9d81-7f86-4e83-a619-7c0454d3a3e9"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] validate_networks() for [('975a9d81-7f86-4e83-a619-7c0454d3a3e9', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting quotas for project 68ab8531e1e740798cff8ce9dd2cb311. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Getting quotas for user a4a78fd7893c4c17acd06b280542b631 and project 68ab8531e1e740798cff8ce9dd2cb311. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:46:50 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:46:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e5362c6f-88eb-4268-adb6-bc78740cf05a tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 449 microversion: 2.1 time: 0.922730 Nov 28 00:46:50 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 110/343] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:46:49 2023] POST /compute/v2.1/servers => generated 449 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:46:50 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7c67b1c1-997c-4dd8-9580-9590971f7844 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:50 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7c67b1c1-997c-4dd8-9580-9590971f7844 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:50 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7c67b1c1-997c-4dd8-9580-9590971f7844 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a78fd7893c4c17acd06b280542b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ab8531e1e740798cff8ce9dd2cb311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:46:50 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7c67b1c1-997c-4dd8-9580-9590971f7844 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9" status: 200 len: 1234 microversion: 2.1 time: 0.098770 Nov 28 00:46:50 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 116/344] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:50 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9 => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:46:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] Creating event network-changed:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:46:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-67ee63ac-edfd-4d46-ae4c-c6d19c4ba148 req-894a2b06-23cf-4805-a8d4-8f13304a803c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040162 Nov 28 00:46:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 119/345] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:54 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc5430b-5c2a-4074-886e-d53482cb2bb9", "tag": "65e249eb-8337-4f50-b643-927be5058f5e"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] Creating event network-changed:65e249eb-8337-4f50-b643-927be5058f5e for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 on user Nov 28 00:46:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-42d3a44d-ed9e-49a4-95a8-82421455d8c6 req-90c1c4e1-c30f-478f-b457-612d65b0ba31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222708 Nov 28 00:46:54 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 111/346] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:56 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}, {"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:46:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:46:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-76eda8f6-003e-4544-a2f0-389ca9dc1dab req-1cfd6a43-55bb-4b79-8b0d-5174b80cb98b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037841 Nov 28 00:46:56 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 117/347] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] [instance: 2619f610-3a3c-4b48-9448-c30d75414e56] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:46:56 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc5430b-5c2a-4074-886e-d53482cb2bb9", "name": "network-vif-plugged", "status": "completed", "tag": "65e249eb-8337-4f50-b643-927be5058f5e"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:56 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] HTTP exception thrown: Instance 2619f610-3a3c-4b48-9448-c30d75414e56 could not be found. Nov 28 00:46:56 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Returning 404 to user: Instance 2619f610-3a3c-4b48-9448-c30d75414e56 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:46:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:56 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-76e29b6c-a29b-4c71-b523-6c0ad6639c6e tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56" status: 404 len: 111 microversion: 2.1 time: 0.050463 Nov 28 00:46:56 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 120/348] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:46:56 2023] GET /compute/v2.1/servers/2619f610-3a3c-4b48-9448-c30d75414e56 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:46:56 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0ddb2d45-790a-478e-87f2-15b90ac43c67 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] Calling method '.version_select at 0x7f49732bd1b0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:46:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] Creating event network-vif-plugged:65e249eb-8337-4f50-b643-927be5058f5e for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 on user Nov 28 00:46:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-2bbc49c6-4fdf-444f-8607-4205c3216ab9 req-555a40ee-7fbd-4298-9285-298bcc36f40b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062532 Nov 28 00:46:56 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 112/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:46:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0ddb2d45-790a-478e-87f2-15b90ac43c67 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421 tempest-TestServerVolumeAttachScenarioOldVersion-1833316421-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867180318" status: 202 len: 0 microversion: 2.1 time: 0.030321 Nov 28 00:46:56 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 118/350] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 00:46:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867180318 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:46:59 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc5430b-5c2a-4074-886e-d53482cb2bb9", "name": "network-vif-plugged", "status": "completed", "tag": "65e249eb-8337-4f50-b643-927be5058f5e"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:46:59 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:46:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:46:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:46:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:46:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] Creating event network-vif-plugged:65e249eb-8337-4f50-b643-927be5058f5e for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 on user Nov 28 00:46:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4b3505db-ca40-4337-98b5-9057dc94f331 req-4c4e2837-8c4f-4ef5-a0c2-a983c4adc048 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062458 Nov 28 00:46:59 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 121/351] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:46:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1991590042", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "4f7cdbae-2a41-4a0e-8669-d9665014c684"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:00 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] validate_networks() for [('4f7cdbae-2a41-4a0e-8669-d9665014c684', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:47:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=10 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Getting quotas for project 6dfd77666ef94a61b16d07a624036091. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Getting quotas for user f1d154145c6944a790da943c75adb000 and project 6dfd77666ef94a61b16d07a624036091. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:47:01 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:47:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-af0e28b2-ae73-4c7f-9c13-14f555d48733 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.871275 Nov 28 00:47:01 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 113/352] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:47:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:47:01 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:01 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=12 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b1e3a44d-1539-4711-9002-d0006cf848df tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:01 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-b1e3a44d-1539-4711-9002-d0006cf848df tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:01 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b1e3a44d-1539-4711-9002-d0006cf848df tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d154145c6944a790da943c75adb000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfd77666ef94a61b16d07a624036091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-b1e3a44d-1539-4711-9002-d0006cf848df tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f" status: 200 len: 1206 microversion: 2.1 time: 0.087517 Nov 28 00:47:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 119/353] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:01 2023] GET /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f => generated 1206 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:02 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:02 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-08041d0a-76b0-4842-a6b3-58b972c4909b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 200 len: 1488 microversion: 2.1 time: 0.953141 Nov 28 00:47:02 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 122/354] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:01 2023] GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 1488 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 00:47:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:02 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:03 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8dd53f8dd874658a31a1aaf40a4091e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e19068366934d7db3a2cb3131af5498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2b7167d9-10b4-4cd0-85a2-20e08ef34f06 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b" status: 200 len: 1488 microversion: 2.1 time: 0.679095 Nov 28 00:47:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 114/355] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:02 2023] GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b => generated 1488 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:03 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:03 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2b64af61-f905-4251-bd5a-5f7710a5c2f5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-interface" status: 200 len: 283 microversion: 2.1 time: 1.116379 Nov 28 00:47:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 120/356] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:47:03 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-interface => generated 283 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:04 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1074b86-5b6a-4d85-a028-ae52d079467f", "tag": "9a83bf89-f8f9-4fc2-9097-829795f361cd"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:04 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] Creating event network-changed:9a83bf89-f8f9-4fc2-9097-829795f361cd for instance d1074b86-5b6a-4d85-a028-ae52d079467f on user Nov 28 00:47:04 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-242fdd50-a302-40ca-a1db-5eab4d3e4b58 req-053830f5-2e6a-4952-9e43-48445707ccb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041969 Nov 28 00:47:04 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 123/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:05 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:05 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] Creating event network-changed:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:47:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-b8cba0a7-cca3-4523-b0bd-09b0325dcdde req-8d04bb65-4ef7-4f79-b865-d2da96fe49d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393364 Nov 28 00:47:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 115/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:06 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5206503d-c883-41bd-a669-3401eb05cd0b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 200 len: 1543 microversion: 2.1 time: 0.247309 Nov 28 00:47:06 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 121/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:05 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 1543 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dcc4ca3-dba8-4e3f-b69a-2093ba519c05"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:06 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-92f6e11a-2265-4d30-b1c8-9a82d2b1ea6d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619599 Nov 28 00:47:06 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 124/360] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:47:06 2023] POST /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1074b86-5b6a-4d85-a028-ae52d079467f", "name": "network-vif-plugged", "status": "completed", "tag": "9a83bf89-f8f9-4fc2-9097-829795f361cd"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] Creating event network-vif-plugged:9a83bf89-f8f9-4fc2-9097-829795f361cd for instance d1074b86-5b6a-4d85-a028-ae52d079467f on user Nov 28 00:47:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-71f78cba-9c54-4ca9-ad64-88911d887580 req-8391d639-ed7d-4541-a77f-bff8be978f55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102187 Nov 28 00:47:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 116/361] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:08 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1074b86-5b6a-4d85-a028-ae52d079467f", "name": "network-vif-plugged", "status": "completed", "tag": "9a83bf89-f8f9-4fc2-9097-829795f361cd"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] Creating event network-vif-plugged:9a83bf89-f8f9-4fc2-9097-829795f361cd for instance d1074b86-5b6a-4d85-a028-ae52d079467f on user Nov 28 00:47:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-6c3789d6-60e5-4575-a3da-d80ac3f57136 req-7d187aec-3964-46bc-b59d-1d8da615a725 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045205 Nov 28 00:47:09 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 122/362] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "6c122d45-aa11-4336-b324-dd51aa4eda4e"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:14 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'flavor' on Instance uuid 92237bf8-8ea4-4f79-938d-6dfe03edd31d {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:15 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'services' on Instance uuid 6f7c5378-aadc-45e4-b3c3-d308e526b03a {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:47:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-768e41c1-8278-473a-8dc8-b6a59b90fe17 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/os-volume_attachments/50546c9b-1f14-449e-b7dd-a9376344f840" status: 202 len: 0 microversion: 2.1 time: 0.489636 Nov 28 00:47:15 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 117/363] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:47:15 2023] DELETE /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/os-volume_attachments/50546c9b-1f14-449e-b7dd-a9376344f840 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:47:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-de774036-ef84-4a41-bdb0-9805c82dd1c7 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d/action" status: 200 len: 29 microversion: 2.87 time: 0.869007 Nov 28 00:47:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 125/364] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 00:47:14 2023] POST /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d/action => generated 29 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:15 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:16 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:16 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4ce1d7dd-7672-4d8f-b7ef-49986e405887 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 200 len: 1775 microversion: 2.87 time: 0.313606 Nov 28 00:47:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 123/365] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:47:15 2023] GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 1775 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:47:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-unplugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] Creating event network-vif-unplugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:47:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-51328087-7a53-4852-8b48-52cb0824f8cf req-da59926b-c2d3-4ed2-8dbf-12bd6ae6e1fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032551 Nov 28 00:47:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 118/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:17 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:17 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:18 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-cd2b2c29-1219-42d0-accc-d56f5bd9df7d tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 200 len: 1708 microversion: 2.1 time: 0.264359 Nov 28 00:47:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 126/367] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:17 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 1708 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestOtherA-server-622494469", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for project 22c31829ff0846fc8584d492bea6cdc4. Resources: dict_keys(['metadata_items']) {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for user f63a0e9261934c8b8e673f069c3376bd and project 22c31829ff0846fc8584d492bea6cdc4. Resources: dict_keys(['metadata_items']) {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1f26d2d3-80ec-46fb-b21a-8f064d4bfffe tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/action" status: 202 len: 1161 microversion: 2.1 time: 0.655465 Nov 28 00:47:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 124/368] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Nov 28 00:47:18 2023] POST /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/action => generated 1161 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 28 00:47:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:18 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:47:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-7ff8278b-f6cb-4cf8-b70b-f7414204339f req-ebd2d7e3-f428-42a5-ae1b-ee4a0ace789a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039348 Nov 28 00:47:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 127/369] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:19 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0a9743c7-37c3-46fc-8201-6cce11a006f8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 200 len: 1734 microversion: 2.1 time: 0.289043 Nov 28 00:47:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 119/370] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:18 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 1734 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:19 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-unplugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] Creating event network-vif-unplugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:47:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-765de75f-0d97-4be8-bfc6-5acc32e42c04 req-295238f5-6e54-4784-b566-be787c2fedf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037579 Nov 28 00:47:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:47:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-3a4f1952-3d0e-44ca-8e8a-f4a9bdde25ce req-a6f20222-f808-413c-8f46-7bcf1d8a132b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038944 Nov 28 00:47:21 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 128/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:47:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:47:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-d8960abb-ffd8-42c3-bbeb-88e35c696c87 req-2faf03ad-06ec-424b-9226-8f4c6951e526 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038527 Nov 28 00:47:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 120/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:47:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-92f9f8a3-5765-4951-afa9-16bf11a519cf req-cf4ca3d3-97be-4894-9165-d03f03a8aa90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029249 Nov 28 00:47:24 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 126/374] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: d9e00566-f7d4-4022-9377-94fcb8f54fd3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] HTTP exception thrown: Instance d9e00566-f7d4-4022-9377-94fcb8f54fd3 could not be found. Nov 28 00:47:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Returning 404 to user: Instance d9e00566-f7d4-4022-9377-94fcb8f54fd3 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:47:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-de503b67-5848-460a-8c1f-575befc254f6 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3" status: 404 len: 111 microversion: 2.1 time: 0.035036 Nov 28 00:47:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 129/375] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:33 2023] GET /compute/v2.1/servers/d9e00566-f7d4-4022-9377-94fcb8f54fd3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:47:35 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=7 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:35 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:47:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-7133fd94-900a-47b7-932c-64729946c098 req-43ad1443-5407-41ee-8c57-bf3d9738b306 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047659 Nov 28 00:47:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 121/376] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:36 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:47:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-183395e9-47c5-42d5-be87-448ccd4518dc tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a" status: 204 len: 0 microversion: 2.1 time: 0.416813 Nov 28 00:47:36 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 127/377] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:47:36 2023] DELETE /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:47:36 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:36 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:37 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6657488fa71b469c954276af7717308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1afcbb4b3643c5ae366c8e39f3d8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:37 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f34e2ef4-e0c1-48a1-a80a-d4bfb1394d32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a" status: 200 len: 1667 microversion: 2.1 time: 0.216310 Nov 28 00:47:37 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 130/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:36 2023] GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a => generated 1667 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:37 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f443cac-7a1c-49d2-9ed1-79a13883688a", "name": "network-vif-unplugged", "status": "completed", "tag": "7b8ba726-9082-4459-86ba-f4317c342dbe"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:37 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] Creating event network-vif-unplugged:7b8ba726-9082-4459-86ba-f4317c342dbe for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a on user Nov 28 00:47:37 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-7e371621-b754-4505-bb45-36e7fa9366a2 req-769bb7d0-2c00-4d4a-a129-2d4eb518d666 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058641 Nov 28 00:47:37 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 122/379] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:47:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-d31b473c-ba5d-4714-9f1f-4ed8d903cddd req-a2b8d0b4-4a5d-4258-8c13-f848c6681585 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038476 Nov 28 00:47:37 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 128/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Going to try to stop instance {{(pid=65278) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 28 00:47:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-9d9af906-65c7-4418-9473-96c5396b6ac3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/action" status: 202 len: 0 microversion: 2.1 time: 0.109376 Nov 28 00:47:38 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 131/381] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:47:38 2023] POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:38 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-890e47f1-1303-45ee-bf83-c851bd71b4c0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1662 microversion: 2.1 time: 0.331777 Nov 28 00:47:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 123/382] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:38 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1662 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-unplugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] Creating event network-vif-unplugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:47:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-2e5dd9fb-3e84-4b9e-84a8-ea10f554efbb req-a7d48d04-3457-4479-850f-ac7017d0eaaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049088 Nov 28 00:47:38 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 129/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:39 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-27c59e03-ed56-4474-b7f5-f97c04889f5e tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1541 microversion: 2.1 time: 0.326024 Nov 28 00:47:39 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 132/384] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:38 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1541 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:39 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f443cac-7a1c-49d2-9ed1-79a13883688a", "name": "network-vif-plugged", "status": "completed", "tag": "7b8ba726-9082-4459-86ba-f4317c342dbe"}, {"server_uuid": "6f443cac-7a1c-49d2-9ed1-79a13883688a", "name": "network-vif-deleted", "tag": "7b8ba726-9082-4459-86ba-f4317c342dbe"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Creating event network-vif-plugged:7b8ba726-9082-4459-86ba-f4317c342dbe for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a on user Nov 28 00:47:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] Creating event network-vif-deleted:7b8ba726-9082-4459-86ba-f4317c342dbe for instance 6f443cac-7a1c-49d2-9ed1-79a13883688a on user Nov 28 00:47:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-fecdcd19-49bd-498a-b0da-251e1261875e req-fd517fe2-38ad-4423-8da3-83c29f1fef61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034135 Nov 28 00:47:39 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 124/385] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:47:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:47:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-8ff8a5e1-e22b-4dd1-8db8-6adf01bfbf36 req-23ae8ead-0388-4bab-a743-9ed0b3ecb2e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027937 Nov 28 00:47:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 130/386] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:47:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:41 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a78fd7893c4c17acd06b280542b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ab8531e1e740798cff8ce9dd2cb311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-82af09f9-9b30-4242-873e-4517200e55b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9" status: 200 len: 1589 microversion: 2.1 time: 0.233062 Nov 28 00:47:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 133/387] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:41 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9 => generated 1589 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=12 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:47:51 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d154145c6944a790da943c75adb000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfd77666ef94a61b16d07a624036091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:47:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-ee9a9ae1-0d83-405f-986a-3bff5f303eff tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f" status: 200 len: 1485 microversion: 2.1 time: 0.193150 Nov 28 00:47:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 125/388] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:47:51 2023] GET /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f => generated 1485 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31755b25-808d-4db2-be48-d0e7d06654f1"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] HTTP exception thrown: Cannot 'attach_volume' instance bf245d26-e901-4fca-8ff5-a3558974294b while it is in vm_state rescued Nov 28 00:48:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Returning 409 to user: Cannot 'attach_volume' instance bf245d26-e901-4fca-8ff5-a3558974294b while it is in vm_state rescued {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:48:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4f1d4a62-3d6f-408d-af77-1ab42b7be345 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047380 Nov 28 00:48:02 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 131/389] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:48:02 2023] POST /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=10 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:02 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fd5b809d-1425-45ee-8b13-39237b187c54 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b/action" status: 202 len: 0 microversion: 2.1 time: 0.078213 Nov 28 00:48:02 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 134/390] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:48:02 2023] POST /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:02 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-8ef43373-1cf8-4085-8814-70d2e97b046b tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 200 len: 1496 microversion: 2.1 time: 0.309387 Nov 28 00:48:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 126/391] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:02 2023] GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 1496 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:03 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-unplugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] Creating event network-vif-unplugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:48:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-4b54c57b-548c-495e-ab0b-cab520dd4c3d req-53f2ea64-91a5-48ef-97c5-39f2f0669376 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034333 Nov 28 00:48:03 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 132/392] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:05 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:48:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:48:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-21781bb5-1471-40fb-9318-7deda6a69b82 req-fabd016a-a508-4cad-a222-49e13b728866 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042354 Nov 28 00:48:05 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 135/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c5fa0eb-8c36-48e7-aa93-3034798b5293"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:06 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:06 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-621d4924-aceb-453d-bf0f-36619e67681d tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 200 len: 1755 microversion: 2.87 time: 0.225894 Nov 28 00:48:06 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 133/394] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:48:06 2023] GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:48:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f5b1bd0b-bea7-4e92-b7a4-58d32614084f tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268859 Nov 28 00:48:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 127/395] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:48:06 2023] POST /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:48:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-0bf7bf96-086e-428d-9b4f-b8953f85d0b1 req-af6bc639-0141-445b-8d2a-80d4c4b77d75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028072 Nov 28 00:48:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 136/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:09 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d115a848-8e55-482a-97c3-7351ac499c29 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 200 len: 1725 microversion: 2.1 time: 0.661818 Nov 28 00:48:09 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 134/397] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:09 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 1725 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:16 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:48:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-eb325aaa-7901-4ca0-a942-e89d0a387c74 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b" status: 204 len: 0 microversion: 2.1 time: 0.110700 Nov 28 00:48:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 128/398] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:48:16 2023] DELETE /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:16 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8dd53f8dd874658a31a1aaf40a4091e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e19068366934d7db3a2cb3131af5498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-13c9d14a-954c-42f6-9b7e-3aa5bea63611 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b" status: 200 len: 1540 microversion: 2.1 time: 0.263113 Nov 28 00:48:16 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 137/399] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:16 2023] GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b => generated 1540 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8307b4a-ad04-4830-9752-5157af5a4f3b", "name": "network-vif-unplugged", "status": "completed", "tag": "79f0240f-a11e-4733-adaa-4a5f4b2ae450"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] Creating event network-vif-unplugged:79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance c8307b4a-ad04-4830-9752-5157af5a4f3b on user Nov 28 00:48:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-c39cf5f6-7b30-4c97-925e-deedf76da047 req-86bd9759-7704-4592-810f-fe919ebe9f25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047405 Nov 28 00:48:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 135/400] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8307b4a-ad04-4830-9752-5157af5a4f3b", "name": "network-vif-deleted", "tag": "79f0240f-a11e-4733-adaa-4a5f4b2ae450"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] Creating event network-vif-deleted:79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance c8307b4a-ad04-4830-9752-5157af5a4f3b on user Nov 28 00:48:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-26327136-13ba-46b5-bda0-aa4378f19b6a req-eff57a0b-48d0-4b40-ad41-3d420762f05a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Nov 28 00:48:17 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 129/401] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8307b4a-ad04-4830-9752-5157af5a4f3b", "name": "network-vif-plugged", "status": "completed", "tag": "79f0240f-a11e-4733-adaa-4a5f4b2ae450"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] Creating event network-vif-plugged:79f0240f-a11e-4733-adaa-4a5f4b2ae450 for instance c8307b4a-ad04-4830-9752-5157af5a4f3b on user Nov 28 00:48:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-dfa523c0-56b3-418a-8c7f-f0c0219389ed req-4a299800-9b0a-4c35-aef2-606528737442 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031133 Nov 28 00:48:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 138/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=12 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=20 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] [instance: 6f443cac-7a1c-49d2-9ed1-79a13883688a] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] HTTP exception thrown: Instance 6f443cac-7a1c-49d2-9ed1-79a13883688a could not be found. Nov 28 00:48:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Returning 404 to user: Instance 6f443cac-7a1c-49d2-9ed1-79a13883688a could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:48:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5c23b0b5-a178-440e-a446-bef42bd7555e tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a" status: 404 len: 111 microversion: 2.1 time: 0.036680 Nov 28 00:48:27 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 136/403] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:27 2023] GET /compute/v2.1/servers/6f443cac-7a1c-49d2-9ed1-79a13883688a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:48:27 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d173afa9-1f7e-4707-912f-1a7c81a1df32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] Calling method '.version_select at 0x7f4973149510>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:27 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d173afa9-1f7e-4707-912f-1a7c81a1df32 tempest-VolumesAdminNegativeTest-119723273 tempest-VolumesAdminNegativeTest-119723273-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094337696" status: 202 len: 0 microversion: 2.1 time: 0.025613 Nov 28 00:48:27 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 130/404] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 00:48:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094337696 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=10 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:29 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c86cada1-31f1-4935-b0f2-7a001713472e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1639 microversion: 2.1 time: 0.244216 Nov 28 00:48:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 139/405] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:28 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1639 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d68a0b21-30f9-4310-8634-255d8fffe85a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.153298 Nov 28 00:48:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 137/406] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:48:39 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/os-interface => generated 282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] Creating event network-changed:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:48:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ee96409e-0683-43e4-882e-efeb94d06435 req-c96fcbe8-d6d5-4d6a-8fc8-321b388d02fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039768 Nov 28 00:48:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 131/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0ee13f61-a4c3-4bb1-9afd-75d633978e82 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Action: 'create', calling method: .version_select at 0x7f4973276dd0>, body: {"keypair": {"name": "tempest-keypair-203777967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICwr1JwJRftU5kre447lnlDt2f2KX3/DqwbJB113j3O2zsuAXuqsThcPT41tsTk9jfmVAAZudlIowQoWHHFW+mYclhvEP0csCZLwOA6zto5fKQOKRHe3kjhg51kkyQZnQ=="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-0ee13f61-a4c3-4bb1-9afd-75d633978e82 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting quotas for project 4ea5483b85d845699f0431b1cf8f6c7f. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-0ee13f61-a4c3-4bb1-9afd-75d633978e82 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting quotas for user 9549789f88df42959b0e1ecce3619f8b and project 4ea5483b85d845699f0431b1cf8f6c7f. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:48:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0ee13f61-a4c3-4bb1-9afd-75d633978e82 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.93 time: 0.172706 Nov 28 00:48:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 140/408] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 00:48:41 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:41 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-99af8a5e-e097-4cac-aa9e-da70d330fd1d tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1541 microversion: 2.1 time: 0.229316 Nov 28 00:48:41 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 138/409] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:41 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1541 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-212b595b-d29c-451d-9f2c-2c5908551df1 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.266258 Nov 28 00:48:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 132/410] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:48:41 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-interface => generated 282 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:41 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-cf327eb8-eba0-417d-8d72-0c400490cd7a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1541 microversion: 2.1 time: 0.287483 Nov 28 00:48:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 141/411] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:41 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1541 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:42 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc5430b-5c2a-4074-886e-d53482cb2bb9", "tag": "65e249eb-8337-4f50-b643-927be5058f5e"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:42 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] Creating event network-changed:65e249eb-8337-4f50-b643-927be5058f5e for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 on user Nov 28 00:48:42 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-7eaf72b1-46d4-485a-9733-d6b8f4c44e4f req-487e2afe-2ae5-48bf-b71e-fbcd106eabd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030625 Nov 28 00:48:42 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 139/412] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:42 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:43 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a78fd7893c4c17acd06b280542b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ab8531e1e740798cff8ce9dd2cb311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-51aed0ba-ecc7-4966-b24b-c79c41cecf3e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9" status: 200 len: 1589 microversion: 2.1 time: 0.357746 Nov 28 00:48:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 133/413] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:42 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9 => generated 1589 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aecabef3-171f-44b5-9f03-cb693bb7ca04"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:46 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e785b1f3-00b1-40e8-a210-426f63841bc0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303409 Nov 28 00:48:46 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 142/414] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:48:46 2023] POST /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:47 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsV293TestJSON-server-1948315245", "imageRef": "", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "50f8fe84-8683-41ef-a5e9-fff99ae620cc"}], "security_groups": [{"name": "tempest-securitygroup--1551481887"}], "key_name": "tempest-keypair-203777967", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c2b4dff1-92b2-4410-a861-a1efbadb6787", "source_type": "volume", "destination_type": "volume", "boot_index": 0, ": true}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] validate_networks() for [('50f8fe84-8683-41ef-a5e9-fff99ae620cc', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting quotas for project 4ea5483b85d845699f0431b1cf8f6c7f. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting quotas for user 9549789f88df42959b0e1ecce3619f8b and project 4ea5483b85d845699f0431b1cf8f6c7f. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:48:48 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2b4dff1-92b2-4410-a861-a1efbadb6787',volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:48:48 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-632eb870-9963-48ab-8495-60132ce813b5 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.93 time: 0.764328 Nov 28 00:48:48 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 140/415] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 00:48:47 2023] POST /compute/v2.1/servers => generated 407 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:48:48 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2b555be4-3f26-4580-849f-e4c532b5d882 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:48 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2b555be4-3f26-4580-849f-e4c532b5d882 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:48 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-2b555be4-3f26-4580-849f-e4c532b5d882 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:48 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-2b555be4-3f26-4580-849f-e4c532b5d882 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:48 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-2b555be4-3f26-4580-849f-e4c532b5d882 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:48 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2b555be4-3f26-4580-849f-e4c532b5d882 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 200 len: 1333 microversion: 2.93 time: 0.061389 Nov 28 00:48:48 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 134/416] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:48:48 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 1333 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:48:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] Creating event network-changed:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:48:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-be11ce59-a180-4b17-9bf2-af08a56392d1 req-9f977fe6-eeca-451f-88f6-e564e7b4c0a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037660 Nov 28 00:48:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 143/417] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:53 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4dc9d84f-5319-45be-a2fb-43fe0bf1c01a tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 200 len: 1502 microversion: 2.1 time: 0.213324 Nov 28 00:48:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 141/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:52 2023] GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=12 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:56 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:48:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-08e991f5-60ca-4995-b12c-1b06ed102082 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f" status: 204 len: 0 microversion: 2.1 time: 0.159156 Nov 28 00:48:57 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 135/419] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:48:56 2023] DELETE /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:57 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d154145c6944a790da943c75adb000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfd77666ef94a61b16d07a624036091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:48:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-98ef8ba6-e936-4964-b914-a8987f4d65c8 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f" status: 200 len: 1491 microversion: 2.1 time: 0.280057 Nov 28 00:48:57 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 144/420] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:48:57 2023] GET /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f => generated 1491 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:48:57 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1074b86-5b6a-4d85-a028-ae52d079467f", "name": "network-vif-unplugged", "status": "completed", "tag": "9a83bf89-f8f9-4fc2-9097-829795f361cd"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:57 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] Creating event network-vif-unplugged:9a83bf89-f8f9-4fc2-9097-829795f361cd for instance d1074b86-5b6a-4d85-a028-ae52d079467f on user Nov 28 00:48:57 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-8df77e53-495f-45e4-b954-25eb420ef9ae req-22cbb300-22f1-4ae8-abc8-2f7d0f8f4786 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038179 Nov 28 00:48:57 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 142/421] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:48:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1074b86-5b6a-4d85-a028-ae52d079467f", "name": "network-vif-deleted", "tag": "9a83bf89-f8f9-4fc2-9097-829795f361cd"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] Creating event network-vif-deleted:9a83bf89-f8f9-4fc2-9097-829795f361cd for instance d1074b86-5b6a-4d85-a028-ae52d079467f on user Nov 28 00:48:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-c6bc0a0f-0d27-4621-97aa-c7cfac3787e1 req-6b5747ae-caea-4b6b-bd15-92c8fdf41228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032527 Nov 28 00:48:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 136/422] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:48:59 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1074b86-5b6a-4d85-a028-ae52d079467f", "name": "network-vif-plugged", "status": "completed", "tag": "9a83bf89-f8f9-4fc2-9097-829795f361cd"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:48:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:48:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:48:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:48:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] Creating event network-vif-plugged:9a83bf89-f8f9-4fc2-9097-829795f361cd for instance d1074b86-5b6a-4d85-a028-ae52d079467f on user Nov 28 00:48:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-de011328-5b41-44cd-ba79-9e7394af0a06 req-12539961-d241-4116-9c9c-3c30b54c2f0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030344 Nov 28 00:48:59 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 145/423] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:48:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:00 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:00 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-plugged", "status": "completed", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] Creating event network-vif-plugged:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:49:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-1d341031-43fe-47ab-9b69-f2f247b496eb req-cb58f8c3-d26a-40b9-8881-653ac67922a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040177 Nov 28 00:49:00 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 143/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:02 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-plugged", "status": "completed", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] Creating event network-vif-plugged:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:49:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-6efbcfad-66f4-44d9-a028-34df74ca1b9b req-5258fe5a-4aff-4d98-9370-374c6dad3a9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042112 Nov 28 00:49:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 137/425] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c48b2ca8-d3b6-4b0d-b96b-11fb9e696ae6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d/action" status: 202 len: 0 microversion: 2.87 time: 0.127477 Nov 28 00:49:06 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 146/426] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 00:49:06 2023] POST /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] HTTP exception thrown: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:06 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Returning 404 to user: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:49:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-bc672f6b-1f0b-4ebf-93f4-a724e9d10638 tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b" status: 404 len: 111 microversion: 2.1 time: 0.053437 Nov 28 00:49:06 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 144/427] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:06 2023] GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] HTTP exception thrown: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. Nov 28 00:49:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Returning 404 to user: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:49:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-aeef843a-f2ec-49e6-935d-73e00ec709ca tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034422 Nov 28 00:49:06 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 147/428] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:49:06 2023] GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:06 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-730f0d9b-9900-4d1f-a62b-c5fe096e2907 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 200 len: 1763 microversion: 2.87 time: 0.399977 Nov 28 00:49:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 138/429] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:49:06 2023] GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 1763 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:49:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-unplugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:07 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] Creating event network-vif-unplugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:49:07 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a887cd56-7126-45db-8187-db1b0c57d395 req-dd5408bf-4d26-40b1-9470-335fafa3f789 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034062 Nov 28 00:49:07 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 145/430] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:08 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'services' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:49:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c6a11320-5358-4be9-9fa7-b4a52272f5b4 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments/aecabef3-171f-44b5-9f03-cb693bb7ca04" status: 202 len: 0 microversion: 2.1 time: 0.184628 Nov 28 00:49:08 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 148/431] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:49:08 2023] DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments/aecabef3-171f-44b5-9f03-cb693bb7ca04 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:49:08 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:08 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:08 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:08 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-8faae1bb-5a32-427f-83d3-5a567e631e24 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057087 Nov 28 00:49:08 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 139/432] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:49:08 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:09 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}, {"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:49:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:49:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-672bd2e0-ffbc-42db-b694-625f433871b6 req-707482a1-1120-4e62-9ed7-a2be9f93a63a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029814 Nov 28 00:49:09 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 146/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:09 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:09 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-23b710f4-2d18-42f8-acaf-51d437e3c286 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 200 len: 1725 microversion: 2.1 time: 0.232367 Nov 28 00:49:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 149/434] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:09 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] HTTP exception thrown: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. Nov 28 00:49:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Returning 404 to user: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:49:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-07b25437-13a6-484d-9794-f1bcb757894a tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b" status: 404 len: 111 microversion: 2.1 time: 0.026978 Nov 28 00:49:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 140/435] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:49:10 2023] DELETE /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] [instance: c8307b4a-ad04-4830-9752-5157af5a4f3b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] HTTP exception thrown: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. Nov 28 00:49:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] Returning 404 to user: Instance c8307b4a-ad04-4830-9752-5157af5a4f3b could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:49:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6edccff8-7d33-4555-8567-7fbae89998aa tempest-DeleteServersTestJSON-1600931395 tempest-DeleteServersTestJSON-1600931395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b" status: 404 len: 111 microversion: 2.1 time: 0.028050 Nov 28 00:49:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 147/436] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:10 2023] GET /compute/v2.1/servers/c8307b4a-ad04-4830-9752-5157af5a4f3b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:10 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-07f47f4c-7467-4898-9f19-265dcc62328c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1660 microversion: 2.1 time: 0.151317 Nov 28 00:49:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 150/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:10 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1660 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:49:11 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 00:49:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-410e623a-0b61-4fac-8a20-92ca78ab49d6 req-8dc5f25d-8466-44b4-93c4-85f4fa07cc81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034730 Nov 28 00:49:11 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 141/438] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=32 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:29 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Going to try to start instance {{(pid=65277) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 28 00:49:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ebc38188-a37e-4e50-936f-c8422253faca tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/action" status: 202 len: 0 microversion: 2.1 time: 0.086414 Nov 28 00:49:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 148/439] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:49:29 2023] POST /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:29 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e28d9671-4443-4fb3-a7ec-52fb9bfc6ddd tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1648 microversion: 2.1 time: 0.282112 Nov 28 00:49:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 151/440] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:29 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1648 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:32 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f74441b7-b3bd-4ce1-94a9-b4d6be6bfaae tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1660 microversion: 2.1 time: 0.270338 Nov 28 00:49:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 142/441] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:31 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1660 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:49:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-70a70182-a14c-43ef-be79-7883dc444c95 req-9bc52aee-e447-476d-8412-da9b47f0fb8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069929 Nov 28 00:49:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 152/442] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-b2857c62-bd9f-4473-9a6c-71e7f272d0af tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1660 microversion: 2.1 time: 0.318552 Nov 28 00:49:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 149/443] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:32 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1660 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:49:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:49:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-1c32b347-8a0b-4cb9-9bde-15935800fbae req-3d9f17e3-6d23-4ea9-93b9-816f62a1809b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044355 Nov 28 00:49:34 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 143/444] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c1e7c82a-2d61-4c99-a8af-4457684acab1 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Action: 'create', calling method: .version_select at 0x7f4973274c10>, body: {"keypair": {"name": "tempest-keypair-818529533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkIoiSuM62B+z4pjgdDfmWJlO/l7dexGru8irECsPUs6n5LMXDQEG7DiiWr3n1h2F8Ncog9y+KoLGXChpOq1SaI5PEnLxuyjuJhypYD1To2xPoOZtba4b+9qUbmPKRSBw=="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:38 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-c1e7c82a-2d61-4c99-a8af-4457684acab1 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Getting quotas for project 4944a899309047f9979213a267d79dc4. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:49:38 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-c1e7c82a-2d61-4c99-a8af-4457684acab1 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Getting quotas for user 8a3f3d233d494eedb5263da5485c8271 and project 4944a899309047f9979213a267d79dc4. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:49:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c1e7c82a-2d61-4c99-a8af-4457684acab1 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.063484 Nov 28 00:49:38 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 153/445] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 00:49:38 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 00:49:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:38 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:39 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:39 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:39 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-27938d09-dca6-4677-a810-0e815bbeec9d tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 200 len: 1720 microversion: 2.93 time: 0.239635 Nov 28 00:49:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 150/446] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:49:38 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:49:39 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-211957985", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "d84b4039-6017-467c-b5de-f0b63819bff1"}, {"port": "c96774b3-2a86-4fae-9733-45e0dc0f4f49", "tag": "port-1"}, {"port": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4", "tag": "port-2"}, {"uuid": "42b0b18b-0fff-44ce-9e07-b271761d0f78", "tag": "net-1"}, {"uuid": "42b0b18b-0fff-44ce-9e07-b271761d0f78"}, {"uuid": "6c8e7691-0880-4017-be6a-7080e0941f38", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6c8e7691-0880-4017-be6a-7080e0941f38", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a6937f5b-e643-48c5-9a70-2ff88d4e5f2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "dce85e62-5265-44e8-ae95-426ad618a9cd", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7fc842d4-89dc-4631-b51f-18f57c6d8711", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1157635646"}], "key_name": "tempest-keypair-818529533", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:40 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] validate_networks() for [('d84b4039-6017-467c-b5de-f0b63819bff1', None, None, None, None, None), (None, None, 'c96774b3-2a86-4fae-9733-45e0dc0f4f49', None, None, None), (None, None, 'c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4', None, None, None), ('42b0b18b-0fff-44ce-9e07-b271761d0f78', None, None, None, None, None), ('42b0b18b-0fff-44ce-9e07-b271761d0f78', None, None, None, None, None), ('6c8e7691-0880-4017-be6a-7080e0941f38', '10.2.2.100', None, None, None, None), ('6c8e7691-0880-4017-be6a-7080e0941f38', '10.2.2.200', None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Getting quotas for project 4944a899309047f9979213a267d79dc4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:49:41 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Getting quotas for user 8a3f3d233d494eedb5263da5485c8271 and project 4944a899309047f9979213a267d79dc4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:49:42 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:49:42 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a6937f5b-e643-48c5-9a70-2ff88d4e5f2d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='dce85e62-5265-44e8-ae95-426ad618a9cd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fc842d4-89dc-4631-b51f-18f57c6d8711',volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:49:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-51b4c5fc-7dec-48bb-b34b-56e86d693117 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 2.385602 Nov 28 00:49:42 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 144/447] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 28 00:49:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 2387 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:49:42 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:42 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b8ff7aa8-79f6-4e4b-bb86-8a123de2a8c9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:42 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b8ff7aa8-79f6-4e4b-bb86-8a123de2a8c9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:42 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-b8ff7aa8-79f6-4e4b-bb86-8a123de2a8c9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:42 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-b8ff7aa8-79f6-4e4b-bb86-8a123de2a8c9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:42 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-b8ff7aa8-79f6-4e4b-bb86-8a123de2a8c9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:42 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b8ff7aa8-79f6-4e4b-bb86-8a123de2a8c9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" status: 200 len: 1276 microversion: 2.42 time: 0.066519 Nov 28 00:49:42 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 154/448] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:49:42 2023] GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 => generated 1276 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:49:47 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "tag": "6d244ad1-2ec1-403c-a79a-fc55601d3713"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] Creating event network-changed:6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:49:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5074e23a-c140-4db0-a655-a1a28bf5e1b4 req-832756ed-07d4-487f-a3fc-4d6475257ae0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034085 Nov 28 00:49:47 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 151/449] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: d1074b86-5b6a-4d85-a028-ae52d079467f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:47 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] HTTP exception thrown: Instance d1074b86-5b6a-4d85-a028-ae52d079467f could not be found. Nov 28 00:49:47 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Returning 404 to user: Instance d1074b86-5b6a-4d85-a028-ae52d079467f could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:49:47 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b756a0af-b62d-4d04-945f-8fbe5c7c9e75 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f" status: 404 len: 111 microversion: 2.1 time: 0.028666 Nov 28 00:49:47 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 145/450] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:47 2023] GET /compute/v2.1/servers/d1074b86-5b6a-4d85-a028-ae52d079467f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:49:47 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-10295081", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "4f7cdbae-2a41-4a0e-8669-d9665014c684"}]}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:47 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] validate_networks() for [('4f7cdbae-2a41-4a0e-8669-d9665014c684', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Getting quotas for project 6dfd77666ef94a61b16d07a624036091. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Getting quotas for user f1d154145c6944a790da943c75adb000 and project 6dfd77666ef94a61b16d07a624036091. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:49:48 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:49:48 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-af8257cf-71d8-4904-b5dc-aa76adb2afaa tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.727999 Nov 28 00:49:48 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 155/451] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:49:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:49:48 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-50acc345-d018-475c-8522-2566b7886bcd tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:48 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-50acc345-d018-475c-8522-2566b7886bcd tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:48 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-50acc345-d018-475c-8522-2566b7886bcd tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d154145c6944a790da943c75adb000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfd77666ef94a61b16d07a624036091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:48 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-50acc345-d018-475c-8522-2566b7886bcd tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65" status: 200 len: 1204 microversion: 2.1 time: 0.066912 Nov 28 00:49:48 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 152/452] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:48 2023] GET /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65 => generated 1204 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:49:49 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "tag": "c96774b3-2a86-4fae-9733-45e0dc0f4f49"}, {"name": "network-changed", "server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "tag": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:49 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Creating event network-changed:c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:49:49 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] Creating event network-changed:c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:49:49 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-45560286-4b15-4590-904e-42eb1fb565e8 req-da1758f5-5930-4cd5-ac9a-5332dc97c48d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030657 Nov 28 00:49:49 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 146/453] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:49 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04175bce-9dc6-432e-8c06-e55f4e2aeb65", "tag": "6fb14075-40d0-488e-86ee-32b1d5ce7c20"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] Creating event network-changed:6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 on user Nov 28 00:49:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-88435afe-f5f5-4981-b2c7-eb7226b89768 req-c9850c3f-cd77-4555-8846-ebb386ec271e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033511 Nov 28 00:49:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 156/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:51 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "tag": "4c25b79e-79ff-420f-bdd9-9392bd703156"}, {"name": "network-changed", "server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "tag": "142e2086-37d6-40f3-a928-4989daf67ba9"}, {"name": "network-changed", "server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "tag": "286b6758-a4bb-46ee-8766-d16fff0e3b25"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Creating event network-changed:4c25b79e-79ff-420f-bdd9-9392bd703156 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:49:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Creating event network-changed:142e2086-37d6-40f3-a928-4989daf67ba9 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:49:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] Creating event network-changed:286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:49:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-d269c0d5-10c3-4731-b394-65bef83d2529 req-5aee2025-282f-4f9c-b3db-715fced1f1e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.037000 Nov 28 00:49:51 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 153/455] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:51 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:53 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:53 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:53 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04175bce-9dc6-432e-8c06-e55f4e2aeb65", "name": "network-vif-plugged", "status": "completed", "tag": "6fb14075-40d0-488e-86ee-32b1d5ce7c20"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] Creating event network-vif-plugged:6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 on user Nov 28 00:49:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-5bd07e81-f165-4629-8b8b-c8d2bd912536 req-1edf8a50-eb62-4f17-884d-d0858be0c3e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055688 Nov 28 00:49:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 147/456] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "tag": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] Creating event network-changed:49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:49:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-656fb14f-70c9-4033-a4de-b7652852b7d9 req-3d6f0696-023d-4c19-b600-3e5c4d604662 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031289 Nov 28 00:49:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 157/457] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:55 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04175bce-9dc6-432e-8c06-e55f4e2aeb65", "name": "network-vif-plugged", "status": "completed", "tag": "6fb14075-40d0-488e-86ee-32b1d5ce7c20"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] Creating event network-vif-plugged:6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 on user Nov 28 00:49:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-120b248a-58ac-427f-a6f0-3c3ebc7bf96b req-c5890afe-e2de-4f04-b7e5-4c9af32a629c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032107 Nov 28 00:49:55 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 154/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:49:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:55 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d722a2ed-1c35-492f-9556-0b69307a417e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'create', calling method: .version_select at 0x7f497314bf40>, body: {"keypair": {"name": "tempest-keypair-986818562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrbgL6uxmLC3MZN+RrqUPtpw5FpUn8maTx0Cf4LCwQCRvDd2+IMQRtiAJBB/3y8VPHozvUpRK0AlMQnI/+Jt36ZBNau3gnhdcxDotPvQEvFguuKb5CmCFRaaKSD+AGTLA=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:55 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-d722a2ed-1c35-492f-9556-0b69307a417e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting quotas for project 4e8c7ba7df64471b83fbfb45237c8ee7. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:49:55 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-d722a2ed-1c35-492f-9556-0b69307a417e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting quotas for user aad5a4c6583f42b39eda624923ded77b and project 4e8c7ba7df64471b83fbfb45237c8ee7. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:49:55 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d722a2ed-1c35-492f-9556-0b69307a417e tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046718 Nov 28 00:49:55 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 148/459] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:49:55 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:57 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-478bfdc7-968a-476e-bad0-79a3cb310f20 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 200 len: 1769 microversion: 2.87 time: 0.313070 Nov 28 00:49:57 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 158/460] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:49:56 2023] GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 1769 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1287657777", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "482f09e3-29f6-48fd-8552-3303e851daac"}], "security_groups": [{"name": "tempest-securitygroup--1967107334"}], "key_name": "tempest-keypair-986818562", "user_data": "}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] validate_networks() for [('482f09e3-29f6-48fd-8552-3303e851daac', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting quotas for project 4e8c7ba7df64471b83fbfb45237c8ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Getting quotas for user aad5a4c6583f42b39eda624923ded77b and project 4e8c7ba7df64471b83fbfb45237c8ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:49:57 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:49:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4ba1e630-1ce9-4e43-a13c-fd2b377ca015 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.572405 Nov 28 00:49:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 155/461] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:49:57 2023] POST /compute/v2.1/servers => generated 407 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:49:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-01499ed2-e6b6-4d84-b10f-5c4e2f74f780 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:58 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-01499ed2-e6b6-4d84-b10f-5c4e2f74f780 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:58 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-01499ed2-e6b6-4d84-b10f-5c4e2f74f780 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:49:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-01499ed2-e6b6-4d84-b10f-5c4e2f74f780 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 200 len: 1237 microversion: 2.1 time: 0.424042 Nov 28 00:49:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 149/462] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:49:58 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 1237 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=12 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:49:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:49:58 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ffdd8b02-7072-49f1-8d83-fde584d3a6ce tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047566 Nov 28 00:49:58 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 159/463] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:49:58 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:50:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] Creating event network-changed:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:50:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-26f21103-90cd-4b24-8a47-438206b4c5b9 req-9fdf16e4-7915-45bc-8006-5e434ae46047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035893 Nov 28 00:50:00 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 156/464] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c7108b3-5be2-44fd-95f0-4155bbde069b"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:01 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-615fc72d-af4b-44ad-876e-f6f7a3a32a78 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277633 Nov 28 00:50:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 150/465] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:50:01 2023] POST /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:50:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-9e4a09c1-8f86-4811-bfc7-c3b0ccee3dab req-adf1788f-cc70-4641-84f4-63976e539c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033319 Nov 28 00:50:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 160/466] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:05 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:50:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0a85d156-38f9-457c-b7a3-75a9bbfcc661 req-347759e2-7b11-4400-9455-11a8048d0530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046250 Nov 28 00:50:05 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 157/467] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:10 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lazy-loading 'services' on Instance uuid ccbf5fa2-6207-49fd-9cca-127fb0358d08 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:50:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-493e3d41-f7e1-4d64-88c4-bb1ed1f766c1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-volume_attachments/5dcc4ca3-dba8-4e3f-b69a-2093ba519c05" status: 202 len: 0 microversion: 2.1 time: 0.174143 Nov 28 00:50:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 151/468] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:50:10 2023] DELETE /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-volume_attachments/5dcc4ca3-dba8-4e3f-b69a-2093ba519c05 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:50:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0e388375-e42d-40e9-a3fe-f4e433ed1318 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054573 Nov 28 00:50:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 161/469] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:50:10 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:14 user devstack@n-api.service[65277]: DEBUG nova.objects.instance [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'services' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=65277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:50:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0e58fe37-d911-43e4-a38b-e5c63b77ab28 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments/1c7108b3-5be2-44fd-95f0-4155bbde069b" status: 202 len: 0 microversion: 2.1 time: 0.161836 Nov 28 00:50:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 158/470] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:50:14 2023] DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments/1c7108b3-5be2-44fd-95f0-4155bbde069b => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:50:14 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:14 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-500520f9-481e-4907-be75-d14ebf1568e7 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061456 Nov 28 00:50:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 152/471] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:50:14 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:50:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "6d244ad1-2ec1-403c-a79a-fc55601d3713"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] Creating event network-vif-plugged:6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-39a280a7-d54c-4780-be8c-716cf91e1402 req-fa6a63ae-8cf6-4583-8005-c627ace68bce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083972 Nov 28 00:50:16 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 162/472] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] Creating event network-vif-plugged:c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-2c1f1db8-ca75-4d45-b4db-364513e8790b req-3a688539-0962-4d9c-ad7f-10e738033182 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038689 Nov 28 00:50:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 159/473] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "142e2086-37d6-40f3-a928-4989daf67ba9"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] Creating event network-vif-plugged:142e2086-37d6-40f3-a928-4989daf67ba9 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-a7de32e7-571d-4d11-8f5b-6bb5402a841a req-788cc4fc-4711-434a-95f9-3af816410159 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030056 Nov 28 00:50:17 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 153/474] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "6d244ad1-2ec1-403c-a79a-fc55601d3713"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "c96774b3-2a86-4fae-9733-45e0dc0f4f49"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "c96774b3-2a86-4fae-9733-45e0dc0f4f49"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:18 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Creating event network-vif-plugged:6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Creating event network-vif-plugged:c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] Creating event network-vif-plugged:c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-ece71bbf-a787-4803-9c3d-6091c23dd546 req-e93f1b13-bb90-48d9-861c-3ab509e2e134 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041373 Nov 28 00:50:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 163/475] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:18 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "4c25b79e-79ff-420f-bdd9-9392bd703156"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "4c25b79e-79ff-420f-bdd9-9392bd703156"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "286b6758-a4bb-46ee-8766-d16fff0e3b25"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "286b6758-a4bb-46ee-8766-d16fff0e3b25"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Creating event network-vif-plugged:c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Creating event network-vif-plugged:4c25b79e-79ff-420f-bdd9-9392bd703156 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Creating event network-vif-plugged:4c25b79e-79ff-420f-bdd9-9392bd703156 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Creating event network-vif-plugged:286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] Creating event network-vif-plugged:286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-ede5339c-986e-4eee-b2ea-57ed2be9013e req-9ec20cea-58f9-4c4d-885d-0301543f416b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.037335 Nov 28 00:50:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 160/476] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:18 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "142e2086-37d6-40f3-a928-4989daf67ba9"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Creating event network-vif-plugged:142e2086-37d6-40f3-a928-4989daf67ba9 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Creating event network-vif-plugged:49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] Creating event network-vif-plugged:49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:50:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-9613acf5-11eb-4ed2-822b-b2a2b1c7c88d req-91dc6754-0115-422f-ab57-624c89041ab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034889 Nov 28 00:50:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 154/477] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:19 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:19 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-996fc30a-d699-4a01-bf38-5a1a9031e713 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1652 microversion: 2.1 time: 0.263516 Nov 28 00:50:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 164/478] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:50:19 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1652 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-555f81cc-7215-44a9-812c-5c2babfab0fd tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" status: 200 len: 2824 microversion: 2.42 time: 0.411987 Nov 28 00:50:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 161/479] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:50:32 2023] GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 => generated 2824 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:50:34 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:34 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:34 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:35 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9c4a8ff8-b4cb-4c73-9407-4095b439c40b tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1660 microversion: 2.1 time: 0.201681 Nov 28 00:50:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 155/480] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:50:34 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1660 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "307a1ca3-5fc8-4700-849a-6b2cbcacd748"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=36 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ac058c15-f64d-42d5-abd4-ac6a4f287c14 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "POST /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271903 Nov 28 00:50:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 165/481] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:50:35 2023] POST /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:38 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d154145c6944a790da943c75adb000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfd77666ef94a61b16d07a624036091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6babd289-049b-4256-a044-4a9e1c08916e tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65" status: 200 len: 1482 microversion: 2.1 time: 0.212849 Nov 28 00:50:38 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 162/482] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:50:38 2023] GET /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65 => generated 1482 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:50:39 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:39 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-bbd586a2-9cb7-4c41-aa57-867fe68a0ec2 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0/os-interface" status: 200 len: 295 microversion: 2.93 time: 0.139934 Nov 28 00:50:39 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 156/483] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 00:50:39 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0/os-interface => generated 295 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] Creating event network-changed:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:50:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-e6d6152c-aa7b-4018-91e0-23dc925c077f req-d3c933bd-7bf0-4377-87d3-c773c39bc8f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029722 Nov 28 00:50:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 163/484] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:40 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:40 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c68539d7-f841-4d2d-87c2-3b83d1a4e720 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 200 len: 1720 microversion: 2.93 time: 0.255460 Nov 28 00:50:40 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 166/485] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:50:40 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 1720 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:50:40 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsV293TestJSON-server-935386610", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:40 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting quotas for project 4ea5483b85d845699f0431b1cf8f6c7f. Resources: dict_keys(['metadata_items']) {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Getting quotas for user 9549789f88df42959b0e1ecce3619f8b and project 4ea5483b85d845699f0431b1cf8f6c7f. Resources: dict_keys(['metadata_items']) {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:41 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "POST /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0/action" status: 202 len: 2043 microversion: 2.93 time: 0.682762 Nov 28 00:50:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 157/486] 10.0.0.210 () {66 vars in 1397 bytes} [Tue Nov 28 00:50:40 2023] POST /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0/action => generated 2043 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 28 00:50:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-318448e2-a99e-46d1-a35e-c86a3304a850 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-318448e2-a99e-46d1-a35e-c86a3304a850 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 423 microversion: 2.93 time: 0.014912 Nov 28 00:50:41 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 164/487] 10.0.0.210 () {64 vars in 1249 bytes} [Tue Nov 28 00:50:41 2023] GET /compute/v2.1/flavors/1 => generated 423 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:41 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-57efaaa0-f18d-46a4-85a8-92cce355f7dd tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 200 len: 1866 microversion: 2.93 time: 0.170648 Nov 28 00:50:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 167/488] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:50:41 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 1866 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:50:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}, {"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-plugged", "status": "completed", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Creating event network-vif-unplugged:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:50:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] Creating event network-vif-plugged:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:50:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-17e4c302-9d60-4c9d-841e-ee6185925909 req-0e5e3494-e71b-48ee-b57e-1982d262105b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035347 Nov 28 00:50:42 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 158/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:42 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Old instance type m1.tiny, new instance type m1.small {{(pid=65277) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting quotas for project b57f21cfce3044c5aad7192a64ce2d8a. Resources: {'cores', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Getting quotas for user e626332697e34a0ba733c723a5ecb328 and project b57f21cfce3044c5aad7192a64ce2d8a. Resources: {'cores', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:50:46 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:50:46 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-af9b3b7e-c50c-475e-8937-24438dbeabdd tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "POST /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/action" status: 202 len: 0 microversion: 2.1 time: 0.290030 Nov 28 00:50:46 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 165/490] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:50:46 2023] POST /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:46 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f5f0d0f4-0a54-442f-9da8-438fe84a2431 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1715 microversion: 2.1 time: 0.209453 Nov 28 00:50:46 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 168/491] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:50:46 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1715 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:48 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:48 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-99c52b2a-c0a3-47f8-ba67-a37388379813 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 200 len: 1551 microversion: 2.1 time: 0.308905 Nov 28 00:50:48 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 159/492] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:50:48 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 1551 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:50:49 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-unplugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Creating event network-vif-unplugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:50:49 user devstack@n-api.service[65277]: DEBUG nova.compute.api [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] Instance 41828b32-f570-4428-8064-5c199a898a04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:50:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-df739de9-271c-4b86-b2a6-8a7d198ae829 req-3ddddb4e-f0eb-4acb-82c2-6f91ee3b0cea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057233 Nov 28 00:50:49 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 166/493] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:50:51 user devstack@n-api.service[65278]: DEBUG nova.compute.api [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] Instance 41828b32-f570-4428-8064-5c199a898a04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:50:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-520ba890-f831-4d51-8f59-72221526307a req-1a3d31ca-ccb1-48c4-9c41-e1d45d0902eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063976 Nov 28 00:50:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 169/494] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1423929614", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] validate_networks() for [('0ce73ad0-6ff4-422c-91dd-e52e37370fe1', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting quotas for project 576886774b2943b999ec92134d8065b4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:50:57 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting quotas for user 8aa0d095400943e28234a9f476ea0a4f and project 576886774b2943b999ec92134d8065b4. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:50:58 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:50:58 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:50:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0f7841ef-b9f2-4f75-bfb6-53088c26e7cc tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.485246 Nov 28 00:50:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 160/495] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 00:50:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:50:58 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:50:58 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4d0f972c-c641-4ba1-b0ee-aeec789417ab tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:50:58 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4d0f972c-c641-4ba1-b0ee-aeec789417ab tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:50:58 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4d0f972c-c641-4ba1-b0ee-aeec789417ab tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:58 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4d0f972c-c641-4ba1-b0ee-aeec789417ab tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:58 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4d0f972c-c641-4ba1-b0ee-aeec789417ab tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:50:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4d0f972c-c641-4ba1-b0ee-aeec789417ab tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9" status: 200 len: 1395 microversion: 2.87 time: 0.085043 Nov 28 00:50:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 167/496] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:50:58 2023] GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9 => generated 1395 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:51:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c9b82c-581e-4e29-8d34-286a293a33f9", "tag": "1137e441-e2d4-4e41-b478-54485b3612f7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] Creating event network-changed:1137e441-e2d4-4e41-b478-54485b3612f7 for instance a5c9b82c-581e-4e29-8d34-286a293a33f9 on user Nov 28 00:51:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-c7b73b73-87b4-499b-bf16-999ba8247840 req-7a1a9082-bb61-45c6-9423-c311090a8ad5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032623 Nov 28 00:51:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 170/497] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-7695998d-2936-454f-b52c-4cc7b13e408c tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042310 Nov 28 00:51:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 161/498] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:51:00 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:01 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:51:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-f6ab4caf-936e-4686-8199-6e16ef0d61de tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 204 len: 0 microversion: 2.1 time: 0.156477 Nov 28 00:51:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 168/499] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:51:00 2023] DELETE /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-unplugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] Creating event network-vif-unplugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:51:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-8766785f-9c72-4782-b801-52f8629a6d0a req-618a237d-3002-42c0-be2f-8b33355c071c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032340 Nov 28 00:51:01 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 162/500] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:01 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a750e30b-ced8-47ff-bcd8-8aa24c31e262 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 200 len: 1685 microversion: 2.1 time: 0.602717 Nov 28 00:51:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 171/501] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:01 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 1685 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:51:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "volume-reimaged", "server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "tag": "c2b4dff1-92b2-4410-a861-a1efbadb6787"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] Creating event volume-reimaged:c2b4dff1-92b2-4410-a861-a1efbadb6787 for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:51:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-38004bb7-14c0-4a4a-95d2-bc1e37d069fd req-e7876225-3848-44b0-83a1-e9cdd5e03d0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.93 time: 0.133109 Nov 28 00:51:02 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 169/502] 10.0.0.210 () {70 vars in 1437 bytes} [Tue Nov 28 00:51:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:51:03 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-deleted", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] Creating event network-vif-deleted:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:51:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-7cdd5b5f-8627-45a3-8181-621b7d865b4c req-33c61525-5d51-47c4-9a06-108ec2f4fc39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029939 Nov 28 00:51:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 163/503] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}, {"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}, {"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}, {"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-unplugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}, {"server_uuid": "ccbf5fa2-6207-49fd-9cca-127fb0358d08", "name": "network-vif-plugged", "status": "completed", "tag": "85cfd155-656c-4678-9381-9603640b1bd4"}, {"server_uuid": "a5c9b82c-581e-4e29-8d34-286a293a33f9", "name": "network-vif-plugged", "status": "completed", "tag": "1137e441-e2d4-4e41-b478-54485b3612f7"}, {"server_uuid": "a5c9b82c-581e-4e29-8d34-286a293a33f9", "name": "network-vif-plugged", "status": "completed", "tag": "1137e441-e2d4-4e41-b478-54485b3612f7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:51:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:51:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:51:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Creating event network-vif-unplugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:51:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Creating event network-vif-plugged:85cfd155-656c-4678-9381-9603640b1bd4 for instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 on user Nov 28 00:51:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Creating event network-vif-plugged:1137e441-e2d4-4e41-b478-54485b3612f7 for instance a5c9b82c-581e-4e29-8d34-286a293a33f9 on user Nov 28 00:51:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] Creating event network-vif-plugged:1137e441-e2d4-4e41-b478-54485b3612f7 for instance a5c9b82c-581e-4e29-8d34-286a293a33f9 on user Nov 28 00:51:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-1a067fcf-437b-4931-8c98-00db08eeab6e req-011ae76c-3225-4f12-a262-5db77bf33415 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1211 microversion: 2.1 time: 0.037829 Nov 28 00:51:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 172/504] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 28 00:51:03 2023] POST /compute/v2.1/os-server-external-events => generated 1211 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:51:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:04 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-3e6e8a3f-4e7f-4093-b760-3d39078587bb tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050123 Nov 28 00:51:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 170/505] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:51:04 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:51:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:51:05 user devstack@n-api.service[65276]: DEBUG nova.compute.api [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] Instance 41828b32-f570-4428-8064-5c199a898a04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65276) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:51:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-661f438e-b11b-4d88-80e8-893ad414a235 req-e710d080-5d13-4b12-8682-0e8605ab6736 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065568 Nov 28 00:51:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 164/506] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d360377-702a-4b82-92ec-8ab269539773"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:07 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:51:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:07 user devstack@n-api.service[65278]: DEBUG nova.compute.api [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] Instance 41828b32-f570-4428-8064-5c199a898a04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:51:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-b2c94069-0f39-4204-9e07-1046607139fb req-ec330e33-3c3c-4e06-b9e3-2f70e2c43ba4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068315 Nov 28 00:51:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 173/507] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:07 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-a11dc816-3458-4815-a0dc-40e64c7f09f5 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480698 Nov 28 00:51:07 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 171/508] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:51:07 2023] POST /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:13 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:13 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-plugged", "status": "completed", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] Creating event network-vif-plugged:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:51:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-12d4f2b9-42d2-48f3-ab33-8535584658b4 req-03740e97-ab34-4db2-808a-c80e1085cd56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036319 Nov 28 00:51:13 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 165/509] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-plugged", "status": "completed", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] Creating event network-vif-plugged:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:51:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4e9fd676-6936-4773-b7e8-24ae3c97ddef req-ef408701-14e1-4cba-8f6e-f2deed2ed99b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Nov 28 00:51:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 174/510] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e3515151-acc1-4955-94ba-136e2ff73069 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057551 Nov 28 00:51:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 172/511] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:51:20 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'services' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:51:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-50819736-d82e-425f-8ca3-c701795bf743 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments/8d360377-702a-4b82-92ec-8ab269539773" status: 202 len: 0 microversion: 2.1 time: 0.215379 Nov 28 00:51:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 166/512] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:51:20 2023] DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments/8d360377-702a-4b82-92ec-8ab269539773 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0d66348d-26f5-4d33-9824-12f4805c09f1 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 204 len: 0 microversion: 2.1 time: 0.142971 Nov 28 00:51:20 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 175/513] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:51:20 2023] DELETE /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:51:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2974224e-10bc-4bca-b1d9-998ddfaea0ec tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056410 Nov 28 00:51:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 173/514] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:51:20 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b9f1a1d5-e13e-42e8-a580-0e470316a3ed tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 200 len: 1658 microversion: 2.1 time: 0.300736 Nov 28 00:51:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 167/515] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:20 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 1658 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-unplugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] Creating event network-vif-unplugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:51:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4d038b32-7ef4-41cc-8fcc-3d67e26e894e req-72a6c3fa-f59c-4dbd-a7c9-bcce4ca7fb86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041741 Nov 28 00:51:20 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 176/516] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-deleted", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] Creating event network-vif-deleted:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:51:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-d3becaf0-7beb-464b-b54d-5b8ac2a58ca4 req-14e0cea9-c6d9-4566-8e2d-715d7cd8fa14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043034 Nov 28 00:51:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 174/517] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7c5378-aadc-45e4-b3c3-d308e526b03a", "name": "network-vif-plugged", "status": "completed", "tag": "598b9806-e561-4d8b-9e33-1e8ec1268b48"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] Creating event network-vif-plugged:598b9806-e561-4d8b-9e33-1e8ec1268b48 for instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a on user Nov 28 00:51:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-17d8b33f-bbb7-4e82-b127-85164c4ea368 req-57c4d6e3-f718-4a13-a48d-7e6f57c8f7f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031483 Nov 28 00:51:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 168/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:32 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:32 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:32 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-eb965900-e7a5-4305-8e98-846c9a073246 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 200 len: 1857 microversion: 2.93 time: 0.218041 Nov 28 00:51:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 177/519] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:51:31 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 1857 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=14 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5affb0d2-9cbe-49cc-9a23-4c36b7716139 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.275976 Nov 28 00:51:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 175/520] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 00:51:32 2023] GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/os-interface => generated 1829 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:51:33 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:33 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=5,nova_cell1:INSERT=5,nova_cell1:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:51:33 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "tag": "6d244ad1-2ec1-403c-a79a-fc55601d3713"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] Creating event network-changed:6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-a7582b38-1968-4ef2-a36d-8485a5ae9962 req-bc381706-9a63-4deb-9e7b-ade148df52a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041128 Nov 28 00:51:33 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 169/521] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:34 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-07fd338a-37e9-46b2-a7c0-816972cea14b tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" status: 200 len: 2824 microversion: 2.42 time: 0.481731 Nov 28 00:51:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 178/522] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:51:34 2023] GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 => generated 2824 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:51:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:34 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7c158e97-2f49-46bd-a145-92b20e1733f9 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.119411 Nov 28 00:51:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 176/523] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 00:51:34 2023] GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3/os-interface => generated 1829 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:51:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-34d20a97-f21e-4df5-b376-4291672ce4dc tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" status: 204 len: 0 microversion: 2.42 time: 0.108454 Nov 28 00:51:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 170/524] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:51:36 2023] DELETE /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3f3d233d494eedb5263da5485c8271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4944a899309047f9979213a267d79dc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-367fb3b2-c3e3-428e-8f94-df0496bfb144 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" status: 200 len: 2948 microversion: 2.42 time: 0.249962 Nov 28 00:51:36 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 179/525] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:51:36 2023] GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 => generated 2948 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:51:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-unplugged", "status": "completed", "tag": "6d244ad1-2ec1-403c-a79a-fc55601d3713"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] Creating event network-vif-unplugged:6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-40a54a92-1b21-4166-8cd0-9bc34c9f8775 req-5b251178-dad0-495e-afb4-0f33589d47b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036881 Nov 28 00:51:36 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 177/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-unplugged", "status": "completed", "tag": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] Creating event network-vif-unplugged:c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-51bcc3d7-9510-47b2-9829-35728d2c22e0 req-4c624903-5535-40e6-becc-32af7727b192 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041337 Nov 28 00:51:36 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 180/527] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-unplugged", "status": "completed", "tag": "142e2086-37d6-40f3-a928-4989daf67ba9"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] Creating event network-vif-unplugged:142e2086-37d6-40f3-a928-4989daf67ba9 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-d5c294a8-c31a-4f42-bc74-afa8a5d79f5b req-05590fff-e3a8-447a-acc5-0490f7e0e854 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036716 Nov 28 00:51:37 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 178/528] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:37 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:37 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0b546ea5-aec4-4f6d-b2d4-589fdaf659ef tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1714 microversion: 2.1 time: 0.358148 Nov 28 00:51:37 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 171/529] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:36 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1714 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:51:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "6d244ad1-2ec1-403c-a79a-fc55601d3713"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-unplugged", "status": "completed", "tag": "c96774b3-2a86-4fae-9733-45e0dc0f4f49"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "c96774b3-2a86-4fae-9733-45e0dc0f4f49"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Creating event network-vif-plugged:6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Creating event network-vif-unplugged:c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] Creating event network-vif-plugged:c96774b3-2a86-4fae-9733-45e0dc0f4f49 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-957317e9-2c97-4c06-ae9d-ac98c52f63ff req-477636fb-3e4f-4b4b-8e97-8b5a41ab2454 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.203921 Nov 28 00:51:38 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 181/530] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-unplugged", "status": "completed", "tag": "4c25b79e-79ff-420f-bdd9-9392bd703156"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "4c25b79e-79ff-420f-bdd9-9392bd703156"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-unplugged", "status": "completed", "tag": "286b6758-a4bb-46ee-8766-d16fff0e3b25"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "286b6758-a4bb-46ee-8766-d16fff0e3b25"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Creating event network-vif-plugged:c6c26ecd-15cb-433e-adb4-f89ac0b3e4a4 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Creating event network-vif-unplugged:4c25b79e-79ff-420f-bdd9-9392bd703156 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Creating event network-vif-plugged:4c25b79e-79ff-420f-bdd9-9392bd703156 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Creating event network-vif-unplugged:286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] Creating event network-vif-plugged:286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a05a46fa-73f9-498b-a503-5cf88b0dd653 req-5cfc270b-3453-4503-ae2b-e45ba77f654b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.049569 Nov 28 00:51:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 179/531] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:39 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "142e2086-37d6-40f3-a928-4989daf67ba9"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-unplugged", "status": "completed", "tag": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-plugged", "status": "completed", "tag": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Creating event network-vif-plugged:142e2086-37d6-40f3-a928-4989daf67ba9 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Creating event network-vif-unplugged:49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] Creating event network-vif-plugged:49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-d9f519fa-3a93-4d53-b672-b9c04127db44 req-b0ff8998-9273-4a9e-94a3-94eed9cb4852 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.035621 Nov 28 00:51:39 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 182/532] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:39 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:51:39 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:51:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9828b46b-4195-4b12-9489-1670c61fe367 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65" status: 204 len: 0 microversion: 2.1 time: 0.131488 Nov 28 00:51:39 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 172/533] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:51:39 2023] DELETE /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:39 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d154145c6944a790da943c75adb000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dfd77666ef94a61b16d07a624036091', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-38bedff6-287d-4792-9797-402a2dc03d42 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65" status: 200 len: 1488 microversion: 2.1 time: 0.493268 Nov 28 00:51:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 180/534] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:39 2023] GET /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65 => generated 1488 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:51:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-ac7399c6-7bdc-415a-9547-c4a056d01575 req-c0c340b2-fc51-47a3-8f02-80b3317d8d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04175bce-9dc6-432e-8c06-e55f4e2aeb65", "name": "network-vif-deleted", "tag": "6fb14075-40d0-488e-86ee-32b1d5ce7c20"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ac7399c6-7bdc-415a-9547-c4a056d01575 req-c0c340b2-fc51-47a3-8f02-80b3317d8d75 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ac7399c6-7bdc-415a-9547-c4a056d01575 req-c0c340b2-fc51-47a3-8f02-80b3317d8d75 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ac7399c6-7bdc-415a-9547-c4a056d01575 req-c0c340b2-fc51-47a3-8f02-80b3317d8d75 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ac7399c6-7bdc-415a-9547-c4a056d01575 req-c0c340b2-fc51-47a3-8f02-80b3317d8d75 service nova] Creating event network-vif-deleted:6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 on user Nov 28 00:51:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-ac7399c6-7bdc-415a-9547-c4a056d01575 req-c0c340b2-fc51-47a3-8f02-80b3317d8d75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028913 Nov 28 00:51:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 183/535] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04175bce-9dc6-432e-8c06-e55f4e2aeb65", "name": "network-vif-unplugged", "status": "completed", "tag": "6fb14075-40d0-488e-86ee-32b1d5ce7c20"}, {"server_uuid": "04175bce-9dc6-432e-8c06-e55f4e2aeb65", "name": "network-vif-plugged", "status": "completed", "tag": "6fb14075-40d0-488e-86ee-32b1d5ce7c20"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Creating event network-vif-unplugged:6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 on user Nov 28 00:51:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] Creating event network-vif-plugged:6fb14075-40d0-488e-86ee-32b1d5ce7c20 for instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 on user Nov 28 00:51:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-9b674f0c-ee8d-44c5-8ab7-3f9c8b6d4275 req-97f704e5-2698-4383-8445-0bafd34623e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031999 Nov 28 00:51:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 173/536] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-deleted", "tag": "49e01d3b-dcb9-4186-bba1-8afe6a8ac210"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] Creating event network-vif-deleted:49e01d3b-dcb9-4186-bba1-8afe6a8ac210 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-9ab1af0b-ec32-416e-a1e9-5a78fd60cb77 req-f110ac25-c179-4c58-918c-0f887b17d2ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029865 Nov 28 00:51:41 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 181/537] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-deleted", "tag": "286b6758-a4bb-46ee-8766-d16fff0e3b25"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-deleted", "tag": "142e2086-37d6-40f3-a928-4989daf67ba9"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-deleted", "tag": "6d244ad1-2ec1-403c-a79a-fc55601d3713"}, {"server_uuid": "f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3", "name": "network-vif-deleted", "tag": "4c25b79e-79ff-420f-bdd9-9392bd703156"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] Creating event network-vif-deleted:286b6758-a4bb-46ee-8766-d16fff0e3b25 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] Creating event network-vif-deleted:142e2086-37d6-40f3-a928-4989daf67ba9 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] Creating event network-vif-deleted:6d244ad1-2ec1-403c-a79a-fc55601d3713 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] Creating event network-vif-deleted:4c25b79e-79ff-420f-bdd9-9392bd703156 for instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 on user Nov 28 00:51:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-732a2aab-8b37-4e07-ba47-46fa4e6710c9 req-7789aebe-ab33-47e4-85b2-d0839ff9fa3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031459 Nov 28 00:51:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 184/538] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:43 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:48 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:48 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-47a4cd8e-2a01-4d28-b859-c77046dd33a9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9" status: 200 len: 1691 microversion: 2.87 time: 0.304142 Nov 28 00:51:48 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 174/539] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:51:48 2023] GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9 => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:51:48 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:48 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e581e9db-d378-42a7-bd30-8214eec15dfb tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.139231 Nov 28 00:51:49 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 182/540] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:51:48 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-interface => generated 282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:49 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:49 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:49 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:49 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:49 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] Creating event network-changed:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:51:49 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-004073e7-dbb5-449b-ab30-9ae8894ed20c req-425c4d60-daef-4036-aefa-694ab69e8236 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031967 Nov 28 00:51:49 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 185/541] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:51:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:49 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "685d49b1-0ae7-4bd5-8960-edfa41570827"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:49 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-6f24dbca-fe00-4a56-b18c-308d9025f67d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264034 Nov 28 00:51:50 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 175/542] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:51:49 2023] POST /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: ccbf5fa2-6207-49fd-9cca-127fb0358d08] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HTTP exception thrown: Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 could not be found. Nov 28 00:51:51 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Returning 404 to user: Instance ccbf5fa2-6207-49fd-9cca-127fb0358d08 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:51:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4494705a-aea8-409d-b667-31f7f30e97c8 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08" status: 404 len: 111 microversion: 2.1 time: 0.026841 Nov 28 00:51:51 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 183/543] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:51 2023] GET /compute/v2.1/servers/ccbf5fa2-6207-49fd-9cca-127fb0358d08 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:51:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-35a040ba-a3a0-48f9-bac9-b809fc358228 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '.version_select at 0x7f4973119a20>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-35a040ba-a3a0-48f9-bac9-b809fc358228 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264480328" status: 202 len: 0 microversion: 2.1 time: 0.026020 Nov 28 00:51:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 186/544] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 00:51:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264480328 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:52 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:52 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-5fce5bdf-8f18-483f-9fee-b6adff8372e6 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1660 microversion: 2.1 time: 0.192844 Nov 28 00:51:52 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 176/545] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:52 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1660 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:52 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-bcdb8a1a-d883-4315-9e21-30a1f402d727 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1660 microversion: 2.1 time: 0.186940 Nov 28 00:51:52 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 184/546] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:52 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1660 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:51:52 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:52 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:53 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:51:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f9a868dd-32f6-41c2-b0eb-8f7cb4d40fa5 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1660 microversion: 2.1 time: 0.244595 Nov 28 00:51:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 187/547] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:52 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1660 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:59 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'flavor' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:51:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2a7caf31-fde8-446b-a74e-41e978f89df9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/action" status: 200 len: 32 microversion: 2.1 time: 0.185188 Nov 28 00:51:59 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 177/548] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:51:59 2023] POST /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:51:59 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:51:59 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:51:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:51:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:51:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:51:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:00 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-222b269c-65ca-4bbd-863c-ef0e5dbedc5f tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 200 len: 1722 microversion: 2.1 time: 0.190207 Nov 28 00:52:00 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 185/549] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:51:59 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:52:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-unplugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] Creating event network-vif-unplugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:52:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-a377845f-a1fd-447a-be09-db5b187dfa99 req-f714bf27-a4d8-4172-8409-a49b71c4545d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089684 Nov 28 00:52:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 188/550] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:52:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:52:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-741ca77a-1937-4027-b0a7-bd917de807b0 req-3b1b7b62-5c33-433e-96bd-d39f07115801 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029949 Nov 28 00:52:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 178/551] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}, {"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:52:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:52:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-9435352f-73dc-4a0c-8798-1f38851f3d5d req-0b427890-a92c-45e2-91bd-f66a837f6394 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027551 Nov 28 00:52:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 186/552] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-4d153e71-636b-4e31-8968-207e4e6e1409 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.184870 Nov 28 00:52:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 189/553] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:52:10 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HTTP exception thrown: Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a could not be found. Nov 28 00:52:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Returning 404 to user: Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:52:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9d1b7c6a-369e-4232-be5d-0882e9131eaa tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 404 len: 111 microversion: 2.1 time: 0.036333 Nov 28 00:52:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 179/554] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:52:10 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:52:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-456f236a-7716-4e59-afa9-d638c917693a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '.version_select at 0x7f4973375ab0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-456f236a-7716-4e59-afa9-d638c917693a tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818574112" status: 202 len: 0 microversion: 2.1 time: 0.027667 Nov 28 00:52:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 187/555] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 00:52:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818574112 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:52:11 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-787a5c3e-e58f-43f7-bc75-43a950889cb3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'create', calling method: .version_select at 0x7f497311a710>, body: {"keypair": {"name": "tempest-keypair-1111325301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY2yzXm9tZGORAhgNmaczx9c+rm3QJjw8ARnx9lTlGqslv2Ded4yePiXHnC6v2wifPYeRqtHuEizTVtpjDOgsHDMsy8qhgWlqGPhwyajoZpjJ1i59I04C6u7dohvS8F3w=="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:11 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-787a5c3e-e58f-43f7-bc75-43a950889cb3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting quotas for project 7cf38cc0048d41bfb69a50d55f9c1963. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:52:11 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-787a5c3e-e58f-43f7-bc75-43a950889cb3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting quotas for user 7cf2b106f48442cd84784a5880737464 and project 7cf38cc0048d41bfb69a50d55f9c1963. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:52:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-787a5c3e-e58f-43f7-bc75-43a950889cb3 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048907 Nov 28 00:52:11 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 190/556] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:52:11 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-222044104", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "7548b01b-c93b-4351-a955-67633111ec0c"}], "security_groups": [{"name": "tempest-securitygroup--1430953409"}], "key_name": "tempest-keypair-1111325301", "user_data": "}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] validate_networks() for [('7548b01b-c93b-4351-a955-67633111ec0c', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:52:13 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc5a6f66-28f3-44c1-b6b8-93e22e704757"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:13 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-345017a6-6343-48e1-9485-65174c4b1115 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291587 Nov 28 00:52:13 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 188/557] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:52:13 2023] POST /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:14 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting quotas for project 7cf38cc0048d41bfb69a50d55f9c1963. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:52:14 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Getting quotas for user 7cf2b106f48442cd84784a5880737464 and project 7cf38cc0048d41bfb69a50d55f9c1963. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:52:14 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:52:14 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:52:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1e62c016-dedc-407f-b6d7-0eba7bd601d2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.831370 Nov 28 00:52:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 180/558] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:52:13 2023] POST /compute/v2.1/servers => generated 400 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:52:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-66c63442-ac63-4b8a-a08c-c0277e54622c tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:14 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-66c63442-ac63-4b8a-a08c-c0277e54622c tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:14 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-66c63442-ac63-4b8a-a08c-c0277e54622c tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-66c63442-ac63-4b8a-a08c-c0277e54622c tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b" status: 200 len: 1229 microversion: 2.1 time: 0.068794 Nov 28 00:52:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 191/559] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:52:14 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b => generated 1229 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:52:17 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f480b3d7-0357-4dca-af75-d4cd264f5a2b", "tag": "2e30b84a-0f54-4293-95c7-339ccf7e830b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:17 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] Creating event network-changed:2e30b84a-0f54-4293-95c7-339ccf7e830b for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b on user Nov 28 00:52:17 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-f8efb951-bca3-4081-9d63-7fbe2b343793 req-2c750ecb-0153-44dd-857d-0f0b6f413136 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112257 Nov 28 00:52:17 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 189/560] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480b3d7-0357-4dca-af75-d4cd264f5a2b", "name": "network-vif-plugged", "status": "completed", "tag": "2e30b84a-0f54-4293-95c7-339ccf7e830b"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] Creating event network-vif-plugged:2e30b84a-0f54-4293-95c7-339ccf7e830b for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b on user Nov 28 00:52:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ed903ad2-f91d-46f0-825b-0f5c9bdf3ef7 req-eb8f6709-f037-4fce-b29c-f026b95290c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130951 Nov 28 00:52:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 181/561] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:21 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=44 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480b3d7-0357-4dca-af75-d4cd264f5a2b", "name": "network-vif-plugged", "status": "completed", "tag": "2e30b84a-0f54-4293-95c7-339ccf7e830b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] Creating event network-vif-plugged:2e30b84a-0f54-4293-95c7-339ccf7e830b for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b on user Nov 28 00:52:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-8a3c31d3-7f58-439e-b1f5-ba0973bb28ff req-e78a1226-b6c3-4e6e-96fe-98616822ba7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059221 Nov 28 00:52:21 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 192/562] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:24 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:25 user devstack@n-api.service[65277]: DEBUG nova.objects.instance [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lazy-loading 'services' on Instance uuid 0fc5430b-5c2a-4074-886e-d53482cb2bb9 {{(pid=65277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:52:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6ff50c5b-ce1a-4242-a6fc-52b84cbf2d0f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments/cc5a6f66-28f3-44c1-b6b8-93e22e704757" status: 202 len: 0 microversion: 2.1 time: 0.171323 Nov 28 00:52:25 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 190/563] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:52:24 2023] DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments/cc5a6f66-28f3-44c1-b6b8-93e22e704757 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c6d0a906-2ffd-4ddf-a430-f4bb9573eb6c tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064013 Nov 28 00:52:25 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 182/564] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:52:25 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:26 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] HTTP exception thrown: Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 could not be found. Nov 28 00:52:26 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Returning 404 to user: Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:52:26 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-15965c85-8153-4fc3-b78b-690ec89d6e7e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" status: 404 len: 111 microversion: 2.42 time: 0.031759 Nov 28 00:52:26 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 193/565] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:52:26 2023] GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:52:26 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-dfaade30-8dd6-4eed-bcb3-49b421beb734 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '.version_select at 0x7f497308b400>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-dfaade30-8dd6-4eed-bcb3-49b421beb734 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818529533" status: 204 len: 0 microversion: 2.42 time: 0.021569 Nov 28 00:52:26 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 191/566] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 00:52:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818529533 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] [instance: 04175bce-9dc6-432e-8c06-e55f4e2aeb65] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:29 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] HTTP exception thrown: Instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 could not be found. Nov 28 00:52:29 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] Returning 404 to user: Instance 04175bce-9dc6-432e-8c06-e55f4e2aeb65 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:52:29 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9dad07ad-5dd1-4d47-9324-7595f4e3b807 tempest-VolumesActionsTest-1457578131 tempest-VolumesActionsTest-1457578131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65" status: 404 len: 111 microversion: 2.1 time: 0.082175 Nov 28 00:52:29 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 183/567] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:52:29 2023] GET /compute/v2.1/servers/04175bce-9dc6-432e-8c06-e55f4e2aeb65 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:30 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] HTTP exception thrown: Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 could not be found. Nov 28 00:52:30 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Returning 404 to user: Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:52:30 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5b661b15-c191-4313-8893-1fad331929d6 tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" status: 404 len: 111 microversion: 2.42 time: 0.026626 Nov 28 00:52:30 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 194/568] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:52:30 2023] DELETE /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] [instance: f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] HTTP exception thrown: Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 could not be found. Nov 28 00:52:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] Returning 404 to user: Instance f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:52:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c97ff65b-cac0-4f36-b673-71d01568981e tempest-TaggedBootDevicesTest_v242-813468473 tempest-TaggedBootDevicesTest_v242-813468473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3" status: 404 len: 111 microversion: 2.42 time: 0.026416 Nov 28 00:52:30 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 192/569] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:52:30 2023] GET /compute/v2.1/servers/f0b6d4de-83f6-43ac-bda9-67a70c9d6bd3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:32 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1a7a2c17-9fa7-4b2a-90a2-7399e678af31 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 200 len: 1857 microversion: 2.93 time: 0.255311 Nov 28 00:52:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 184/570] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:52:32 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 1857 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:32 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:52:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-629f090e-2bc4-4271-adcc-767276cee663 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 204 len: 0 microversion: 2.93 time: 0.164983 Nov 28 00:52:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 195/571] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:52:32 2023] DELETE /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:33 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:33 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] Creating event network-vif-unplugged:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:52:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-636333eb-ca63-43bf-967e-7dd523ce2ecb req-d62a9393-026e-4837-b6ab-3cda14c4764e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045532 Nov 28 00:52:33 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 185/572] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:33 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:33 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:33 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9549789f88df42959b0e1ecce3619f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea5483b85d845699f0431b1cf8f6c7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-b7aecda3-b434-4527-84e2-b4dd413e4651 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 200 len: 1863 microversion: 2.93 time: 0.433044 Nov 28 00:52:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 193/573] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:52:32 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 1863 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:52:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-deleted", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] Creating event network-vif-deleted:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:52:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-1c528755-7dc4-4859-aade-11d8f266cc9a req-8070bbc2-ce9e-4dde-9120-044e87878f58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 Nov 28 00:52:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 196/574] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e2c36d-6ae4-4af8-8511-5d36532b76e0", "name": "network-vif-plugged", "status": "completed", "tag": "2d3f6903-a024-4928-afba-ce8273784c3e"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:35 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:35 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=103,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] Creating event network-vif-plugged:2d3f6903-a024-4928-afba-ce8273784c3e for instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 on user Nov 28 00:52:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-6fd0d180-e382-42bf-9fdc-8c06ed59bdaf req-de9b41f3-5554-48ad-9373-69633e7d206b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037733 Nov 28 00:52:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 186/575] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:37 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5a718f76-cfbd-4ccb-9ac8-55e37d08b372 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "POST /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/action" status: 202 len: 0 microversion: 2.1 time: 0.551061 Nov 28 00:52:37 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 194/576] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:52:37 2023] POST /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:52:37 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:37 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:38 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-600da547-bd25-41b9-90ea-f89d56bef87a tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1713 microversion: 2.1 time: 0.325860 Nov 28 00:52:38 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 197/577] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:52:37 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1713 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:52:38 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-unplugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Creating event network-vif-unplugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:52:38 user devstack@n-api.service[65276]: DEBUG nova.compute.api [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] Instance 41828b32-f570-4428-8064-5c199a898a04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65276) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:52:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-d10eb8d7-2666-442b-b8e9-667aaeaf4e50 req-cf58d2bb-ab07-49b7-879a-e237b859d8b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044925 Nov 28 00:52:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 187/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:52:40 user devstack@n-api.service[65277]: DEBUG nova.compute.api [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] Instance 41828b32-f570-4428-8064-5c199a898a04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:52:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-2e00d190-7279-482c-903b-53ef978fc103 req-dd364f9d-6a6a-4558-8e9a-5e36e5e1375d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043909 Nov 28 00:52:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 195/579] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1617652780"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:49 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-dd04213a-4568-4e69-8d45-382c671b9757 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9/action" status: 202 len: 52 microversion: 2.87 time: 1.286163 Nov 28 00:52:49 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 198/580] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 00:52:48 2023] POST /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9/action => generated 52 bytes in 1288 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=5 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:50 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:52:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-93d63b5b-a2d3-45fe-ba0e-dd78d163cd8d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 200 len: 1702 microversion: 2.1 time: 0.546573 Nov 28 00:52:50 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 188/581] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:52:50 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 1702 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:52:54 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:54 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:52:54 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:52:55 user devstack@n-api.service[65277]: DEBUG nova.compute.api [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] Instance 41828b32-f570-4428-8064-5c199a898a04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:52:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-e270b8e6-3999-4fd1-9a40-a83c84290d0f req-79ed8b45-6e84-4c28-b974-cd5d632fe4dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061037 Nov 28 00:52:55 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 196/582] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:52:57 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:52:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:52:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:52:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:52:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:52:57 user devstack@n-api.service[65278]: DEBUG nova.compute.api [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] Instance 41828b32-f570-4428-8064-5c199a898a04 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:52:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-0785e57c-ef18-4e9b-a407-03c4962d6725 req-abd8cff9-c6b0-4905-8eb4-6bbaa67b9ffc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049827 Nov 28 00:52:57 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 199/583] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:52:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0fcb70a5-0ab9-41ac-b45b-dec2523fb175 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'create', calling method: .version_select at 0x7f4972f9c820>, body: {"keypair": {"name": "tempest-keypair-1702320399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpUFquDeumIIdDQAaGyNyeGGAa5cfVSI7FFpRzGGGZzYV4GV1jUbn8wjNU0WSYASKLUcvewvIMnW8sX+yZuTGWUBWmFHdYqYTml4tXyMStLNULR7tj9BXfQY6FltgCdBQ=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:00 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-0fcb70a5-0ab9-41ac-b45b-dec2523fb175 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting quotas for project 52c236f1599d4a4fb181b4aa73058211. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:53:00 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-0fcb70a5-0ab9-41ac-b45b-dec2523fb175 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting quotas for user 1fd50f4f867e4efcad9e16d45dde6df0 and project 52c236f1599d4a4fb181b4aa73058211. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:53:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0fcb70a5-0ab9-41ac-b45b-dec2523fb175 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.245305 Nov 28 00:53:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 189/584] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 00:53:00 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 247 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 00:53:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:00 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-965644235", "imageRef": "", "flavorRef": "1", "networks": [{"uuid": "1fef710f-91b8-46ea-a616-1a2c3c3ff203"}], "security_groups": [{"name": "tempest-securitygroup--565879118"}], "key_name": "tempest-keypair-1133257069", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "cbf2ecb0-05e5-411a-9dfb-33928d958c2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:00 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] validate_networks() for [('1fef710f-91b8-46ea-a616-1a2c3c3ff203', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:53:01 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:01 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:01 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-a7e4c1dd-076d-4dbe-b1e4-1c21434472d5 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9" status: 200 len: 1691 microversion: 2.87 time: 0.386667 Nov 28 00:53:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 197/585] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:53:00 2023] GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9 => generated 1691 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for user f63a0e9261934c8b8e673f069c3376bd and project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:53:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbf2ecb0-05e5-411a-9dfb-33928d958c2c',volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:53:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-4f1357a6-fc85-4084-8c63-2980ef7d9bdb tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.863638 Nov 28 00:53:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 200/586] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:53:00 2023] POST /compute/v2.1/servers => generated 403 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 28 00:53:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f668db5a-d43e-4db7-adf3-f7f60b7b751a tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:01 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f668db5a-d43e-4db7-adf3-f7f60b7b751a tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:01 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:01 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-f668db5a-d43e-4db7-adf3-f7f60b7b751a tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f668db5a-d43e-4db7-adf3-f7f60b7b751a tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1075 microversion: 2.1 time: 0.110942 Nov 28 00:53:01 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 190/587] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:53:01 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1075 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2078984112", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e1a22e53-570e-48e3-97d1-6913705b3f8b"}], "security_groups": [{"name": "tempest-securitygroup--1664367388"}], "key_name": "tempest-keypair-1702320399", "user_data": "}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] validate_networks() for [('e1a22e53-570e-48e3-97d1-6913705b3f8b', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:03 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting quotas for project 52c236f1599d4a4fb181b4aa73058211. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:53:03 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting quotas for user 1fd50f4f867e4efcad9e16d45dde6df0 and project 52c236f1599d4a4fb181b4aa73058211. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:53:03 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:53:03 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:53:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ed593c07-28e7-46ea-bbd1-39722ab9d8b6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.972088 Nov 28 00:53:03 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 198/588] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 00:53:02 2023] POST /compute/v2.1/servers => generated 400 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:53:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-17252006-7924-4a36-b2b9-59c74870dc8a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:03 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-17252006-7924-4a36-b2b9-59c74870dc8a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:03 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-17252006-7924-4a36-b2b9-59c74870dc8a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:03 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-17252006-7924-4a36-b2b9-59c74870dc8a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:03 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-17252006-7924-4a36-b2b9-59c74870dc8a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-17252006-7924-4a36-b2b9-59c74870dc8a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 200 len: 1274 microversion: 2.20 time: 0.080020 Nov 28 00:53:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 201/589] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:53:03 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:04 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:04 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f485ad49-1a33-49e6-a992-aa482ad45da6 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b" status: 200 len: 1534 microversion: 2.1 time: 0.378873 Nov 28 00:53:04 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 191/590] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:53:04 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b => generated 1534 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:53:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] Creating event network-changed:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:53:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-feb611a0-17bb-4afd-877a-1d94a95a66c6 req-10daca7a-bf99-4809-a9bd-8f0a168e4475 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046550 Nov 28 00:53:05 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 199/591] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] Creating event network-changed:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:53:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-6ab9ac3a-a042-4442-a0ed-75200b84d8ab req-1e0fa541-d94b-4753-b2a9-1e54797887d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035744 Nov 28 00:53:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 202/592] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-plugged", "status": "completed", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] Creating event network-vif-plugged:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:53:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-263a0152-6531-4efe-a58b-e5676bdd44ca req-dfe7908c-f97c-4ae5-92cd-ae9577bc7308 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035716 Nov 28 00:53:09 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 192/593] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:11 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-plugged", "status": "completed", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:11 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] Creating event network-vif-plugged:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:53:11 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-fc1d50b1-faa7-4a5b-ac64-bd0f6e1ea440 req-e71834d0-1345-46b3-bd67-c9b0b834d116 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046485 Nov 28 00:53:11 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 200/594] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:14 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:14 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-plugged", "status": "completed", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] Creating event network-vif-plugged:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:53:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-f8c66790-13cb-4fbb-b6e3-26373904bc9a req-642f7254-03d2-495f-b0b7-42733b0fb8e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038295 Nov 28 00:53:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 203/595] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-38c4edfa-f148-4f29-ac31-0cda8ed0e8d0 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055422 Nov 28 00:53:15 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 193/596] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:53:15 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:53:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-plugged", "status": "completed", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:16 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:16 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] Creating event network-vif-plugged:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:53:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-e9b166fd-fbf8-4d40-a9f1-e69da143be9a req-e1384e96-92d7-49fe-ae7f-b1fe882a68ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046675 Nov 28 00:53:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 201/597] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] [instance: 72e2c36d-6ae4-4af8-8511-5d36532b76e0] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] HTTP exception thrown: Instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 could not be found. Nov 28 00:53:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Returning 404 to user: Instance 72e2c36d-6ae4-4af8-8511-5d36532b76e0 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:53:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-4f8111f4-5fc3-4c8f-b07c-0d596af658ba tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0" status: 404 len: 111 microversion: 2.93 time: 0.040647 Nov 28 00:53:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 204/598] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:53:23 2023] GET /compute/v2.1/servers/72e2c36d-6ae4-4af8-8511-5d36532b76e0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 00:53:23 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1e40a3c2-5fe2-4ddb-98f1-d33e771bcf14 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] Calling method '.version_select at 0x7f4972f9d6c0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:23 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1e40a3c2-5fe2-4ddb-98f1-d33e771bcf14 tempest-ServerActionsV293TestJSON-1839048538 tempest-ServerActionsV293TestJSON-1839048538-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203777967" status: 204 len: 0 microversion: 2.93 time: 0.045285 Nov 28 00:53:23 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 194/599] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 00:53:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203777967 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:53:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7a602aac-cfe1-411b-bbc2-480cacc20000 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Action: 'create', calling method: .version_select at 0x7f4972f95240>, body: {"keypair": {"name": "tempest-TestStampPattern-1933151860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpEAZ5xtvulcDUuDbJ/j3Y5AHFpTQkR5GpOvObn2+H6JLwwGqYi67mtyq7t7205PEbf8U6ta14KfPtM/BjAQzSTLYimw1nvbKqQi0JMFcNkoVhF3qEi1m4VecI+j5UloA=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:25 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-7a602aac-cfe1-411b-bbc2-480cacc20000 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting quotas for project 7a6914d589cc40088c765d5ae8fdd28c. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:53:25 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-7a602aac-cfe1-411b-bbc2-480cacc20000 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting quotas for user 725ae105f36b4b1ca7422d6237a51ff8 and project 7a6914d589cc40088c765d5ae8fdd28c. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:53:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7a602aac-cfe1-411b-bbc2-480cacc20000 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.309489 Nov 28 00:53:25 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 202/600] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:53:25 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:28 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=14 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:28 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-191779408", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "key_name": "tempest-TestStampPattern-1933151860", "security_groups": [{"name": "tempest-secgroup-smoke-295838016"}], "networks": [{"uuid": "d65f0111-ef66-4c05-8da0-00fdbf788b0b"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:28 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] validate_networks() for [('d65f0111-ef66-4c05-8da0-00fdbf788b0b', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:53:28 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:28 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ff92df63-629c-4f43-bd85-50b24f6bb6e0 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1706 microversion: 2.1 time: 0.526279 Nov 28 00:53:28 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 205/601] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:53:28 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1706 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting quotas for project 7a6914d589cc40088c765d5ae8fdd28c. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting quotas for user 725ae105f36b4b1ca7422d6237a51ff8 and project 7a6914d589cc40088c765d5ae8fdd28c. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:53:29 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:53:29 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-aa5034da-e436-43dc-916d-365b5c367271 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.085062 Nov 28 00:53:29 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 195/602] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:53:28 2023] POST /compute/v2.1/servers => generated 403 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:53:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=18 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c61dcd12-0fff-4445-a4d2-f58d8923a0d1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:29 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c61dcd12-0fff-4445-a4d2-f58d8923a0d1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:29 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-c61dcd12-0fff-4445-a4d2-f58d8923a0d1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c61dcd12-0fff-4445-a4d2-f58d8923a0d1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84" status: 200 len: 1234 microversion: 2.1 time: 0.114844 Nov 28 00:53:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 203/603] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:53:29 2023] GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84 => generated 1234 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:53:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3702ef7a-256e-4dbe-9b8c-2980c83ddb84", "tag": "2c602f33-1cb2-4d10-b074-9348e302816a"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] Creating event network-changed:2c602f33-1cb2-4d10-b074-9348e302816a for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 on user Nov 28 00:53:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-d9f2ebaf-06ce-4a9a-8826-47565c16e762 req-20233a0b-25f9-4a90-a7a4-cadfeb7584f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050714 Nov 28 00:53:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 206/604] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3702ef7a-256e-4dbe-9b8c-2980c83ddb84", "name": "network-vif-plugged", "status": "completed", "tag": "2c602f33-1cb2-4d10-b074-9348e302816a"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] Creating event network-vif-plugged:2c602f33-1cb2-4d10-b074-9348e302816a for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 on user Nov 28 00:53:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-e72af5ea-de8b-4e2c-9091-20b6f1cfbbf4 req-c8f061bd-c168-43ae-a21c-13765c5a5a8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041598 Nov 28 00:53:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 196/605] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3702ef7a-256e-4dbe-9b8c-2980c83ddb84", "name": "network-vif-plugged", "status": "completed", "tag": "2c602f33-1cb2-4d10-b074-9348e302816a"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] Creating event network-vif-plugged:2c602f33-1cb2-4d10-b074-9348e302816a for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 on user Nov 28 00:53:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0ef8325e-55da-45ad-9019-b2c9a65bd657 req-f42e7367-bcfc-437c-b717-7871353b5d18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033999 Nov 28 00:53:37 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 204/606] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:42 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:53:42 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f50177e0-0e39-453f-af64-53cc484aafb2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9" status: 204 len: 0 microversion: 2.1 time: 0.142886 Nov 28 00:53:42 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 207/607] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:53:42 2023] DELETE /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:42 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a78fd7893c4c17acd06b280542b631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ab8531e1e740798cff8ce9dd2cb311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1065236c-3719-4a33-89a4-10b40f2d94a2 tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9" status: 200 len: 1714 microversion: 2.1 time: 0.465516 Nov 28 00:53:42 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 197/608] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:53:42 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9 => generated 1714 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:53:42 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:42 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc5430b-5c2a-4074-886e-d53482cb2bb9", "name": "network-vif-unplugged", "status": "completed", "tag": "65e249eb-8337-4f50-b643-927be5058f5e"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:42 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] Creating event network-vif-unplugged:65e249eb-8337-4f50-b643-927be5058f5e for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 on user Nov 28 00:53:42 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-3d101616-aa23-4113-b06d-d4f1f4065a1c req-e13261c4-0726-4502-bc9d-960a8e264501 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038817 Nov 28 00:53:42 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 205/609] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc5430b-5c2a-4074-886e-d53482cb2bb9", "name": "network-vif-deleted", "tag": "65e249eb-8337-4f50-b643-927be5058f5e"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] Creating event network-vif-deleted:65e249eb-8337-4f50-b643-927be5058f5e for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 on user Nov 28 00:53:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4e80b90b-b0c5-4126-b4db-0fd60ec84b68 req-ea7e8cbc-8943-4168-aa3c-858a1b4a95f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041501 Nov 28 00:53:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 208/610] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:44 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc5430b-5c2a-4074-886e-d53482cb2bb9", "name": "network-vif-plugged", "status": "completed", "tag": "65e249eb-8337-4f50-b643-927be5058f5e"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] Creating event network-vif-plugged:65e249eb-8337-4f50-b643-927be5058f5e for instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 on user Nov 28 00:53:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-21576c45-0d0f-464b-992f-f762510bade3 req-a1a96bef-5381-4980-ae4d-f9c5c7fbf3ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027310 Nov 28 00:53:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 198/611] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:50 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:50 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] HTTP exception thrown: Cannot 'detach_volume' instance a835216a-04a1-4660-a458-13cca79489c3 while it is in vm_state rescued Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Returning 409 to user: Cannot 'detach_volume' instance a835216a-04a1-4660-a458-13cca79489c3 while it is in vm_state rescued {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:53:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-99d8b21c-2057-43a1-8177-244ab89f29c6 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments/685d49b1-0ae7-4bd5-8960-edfa41570827" status: 409 len: 152 microversion: 2.1 time: 0.098091 Nov 28 00:53:51 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 206/612] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:53:50 2023] DELETE /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments/685d49b1-0ae7-4bd5-8960-edfa41570827 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:51 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:53:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0d0087e9-e8bb-4aaa-a9be-4ef394fc20f9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/action" status: 202 len: 0 microversion: 2.1 time: 0.085127 Nov 28 00:53:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 209/613] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:53:51 2023] POST /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:51 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-4760e725-7d3c-4c56-9ecf-c5cdc972fc4d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 200 len: 1710 microversion: 2.1 time: 0.481419 Nov 28 00:53:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 199/614] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:53:51 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 1710 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:52 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-unplugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] Creating event network-vif-unplugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:53:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-eb0bf924-edab-4050-8a3c-bfd78603bbc1 req-5c580296-b9da-49a6-84ea-a22046c3cfcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033148 Nov 28 00:53:52 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 210/615] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:52 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-268a6ce0-b278-4cd0-a189-3c7c05864187 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1428 microversion: 2.1 time: 0.251647 Nov 28 00:53:52 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 207/616] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:53:51 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1428 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1752779599", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "a141f326-29c7-4dac-b92c-95a7f24ef513", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e7a9c673-be29-4f27-b00a-34793dbf68b7"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] validate_networks() for [('e7a9c673-be29-4f27-b00a-34793dbf68b7', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:53:53 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a141f326-29c7-4dac-b92c-95a7f24ef513',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:53 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e13825a9-a442-4746-90a3-6645121bf148 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 200 len: 1586 microversion: 2.20 time: 0.358535 Nov 28 00:53:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 211/617] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:53:53 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 1586 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:53:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-ba8c93d4-5c7f-4196-9bec-ca09f5c06a24 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.764361 Nov 28 00:53:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 200/618] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:53:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:53:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cbc1895d-fcf1-418c-886f-41f6d56cb050 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:53:53 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cbc1895d-fcf1-418c-886f-41f6d56cb050 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:53:53 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-cbc1895d-fcf1-418c-886f-41f6d56cb050 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:53:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-cbc1895d-fcf1-418c-886f-41f6d56cb050 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 200 len: 1050 microversion: 2.1 time: 0.066266 Nov 28 00:53:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 208/619] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:53:53 2023] GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 1050 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:53:54 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}, {"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}, {"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:54 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:53:54 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:53:54 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:53:54 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-8fe950e5-b937-45de-a0b9-01395950b156 req-2dec54f9-9b7a-461c-bc95-052f8b16e206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053571 Nov 28 00:53:54 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 212/620] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:54 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:53:56 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d7f368b-5aca-4be6-8844-a207bee693b2", "tag": "ad4c074f-c4eb-44e5-af60-5d63c0776018"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:53:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:53:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:53:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:53:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] Creating event network-changed:ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance 9d7f368b-5aca-4be6-8844-a207bee693b2 on user Nov 28 00:53:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-3cf8a5d0-d8de-49ca-bc8f-02b018e72f30 req-208216b9-8b7d-4201-905a-763e7424d875 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031580 Nov 28 00:53:56 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 201/621] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:53:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-389395682", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "0eca691f-8ae7-4ede-a543-e4f526783da7", "destination_type": "volume"}], "networks": [{"uuid": "0ce73ad0-6ff4-422c-91dd-e52e37370fe1"}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] validate_networks() for [('0ce73ad0-6ff4-422c-91dd-e52e37370fe1', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting quotas for project 576886774b2943b999ec92134d8065b4. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Getting quotas for user 8aa0d095400943e28234a9f476ea0a4f and project 576886774b2943b999ec92134d8065b4. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:54:01 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:54:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6cfa908c-78c1-4bb6-a70d-87bb8d38fc2c tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.638040 Nov 28 00:54:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 209/622] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 00:54:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 00:54:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fbbff822-80dd-4a19-9071-167f587e3cc6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-fbbff822-80dd-4a19-9071-167f587e3cc6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:01 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-fbbff822-80dd-4a19-9071-167f587e3cc6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:01 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-fbbff822-80dd-4a19-9071-167f587e3cc6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:01 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-fbbff822-80dd-4a19-9071-167f587e3cc6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:02 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fbbff822-80dd-4a19-9071-167f587e3cc6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 200 len: 1394 microversion: 2.87 time: 0.071417 Nov 28 00:54:02 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 213/623] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:54:01 2023] GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 1394 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:54:04 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:04 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:04 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:04 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:04 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] Creating event network-changed:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:54:04 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-0d3b3222-d870-4919-9775-80ff69461a86 req-23bb37fa-1f4e-4558-937d-6060801ebba7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037355 Nov 28 00:54:04 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 202/624] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:04 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6a3821af-9e6b-476c-a7eb-8f5d540bcb65 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184290 Nov 28 00:54:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 210/625] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:54:04 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-interface => generated 282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:54:05 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f480b3d7-0357-4dca-af75-d4cd264f5a2b", "tag": "2e30b84a-0f54-4293-95c7-339ccf7e830b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:05 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] Creating event network-changed:2e30b84a-0f54-4293-95c7-339ccf7e830b for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b on user Nov 28 00:54:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4f7c8b3c-7cc6-4745-9c24-574e1309637b req-3451ceea-68ba-4029-bd99-49608c6abb43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035514 Nov 28 00:54:05 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 214/626] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:54:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:05 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-99d42351-8266-49a7-96f5-c227283617a4 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/ips" status: 200 len: 103 microversion: 2.1 time: 0.035714 Nov 28 00:54:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 203/627] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 00:54:05 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/ips => generated 103 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:08 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96cca523-fcec-4118-9da5-3cd8302ca3eb"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:08 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-fef0cfe3-7a89-4080-aaa2-18a173ae2b21 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267312 Nov 28 00:54:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 211/628] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:54:08 2023] POST /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:11 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7f368b-5aca-4be6-8844-a207bee693b2", "name": "network-vif-plugged", "status": "completed", "tag": "ad4c074f-c4eb-44e5-af60-5d63c0776018"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] Creating event network-vif-plugged:ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance 9d7f368b-5aca-4be6-8844-a207bee693b2 on user Nov 28 00:54:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-436edf90-ce26-4553-b300-7355f1f420c0 req-06f304c3-8a9b-4da6-acd4-aac2ac24a424 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051399 Nov 28 00:54:11 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 215/629] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7f368b-5aca-4be6-8844-a207bee693b2", "name": "network-vif-plugged", "status": "completed", "tag": "ad4c074f-c4eb-44e5-af60-5d63c0776018"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] Creating event network-vif-plugged:ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance 9d7f368b-5aca-4be6-8844-a207bee693b2 on user Nov 28 00:54:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-98ee4a60-d8ed-4c71-bea3-120743fa1bad req-9954f18a-d554-4bbc-a58f-25ff5176b092 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051365 Nov 28 00:54:13 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 204/630] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2fcb459b-dfcd-4f8f-9135-f3950bc1cdff tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055606 Nov 28 00:54:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 212/631] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:54:19 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b2ccd090-860c-4634-a86c-d25adb508628 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/96cca523-fcec-4118-9da5-3cd8302ca3eb" status: 200 len: 194 microversion: 2.1 time: 0.053780 Nov 28 00:54:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 216/632] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 00:54:19 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/96cca523-fcec-4118-9da5-3cd8302ca3eb => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:19 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-459ff603-8462-4bfc-8adf-72b0f99f1d5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84" status: 200 len: 1536 microversion: 2.1 time: 0.215041 Nov 28 00:54:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 205/633] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:54:19 2023] GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84 => generated 1536 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:54:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:54:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a85bd6e2-a739-418d-b388-52fddb544661 req-9dc33da5-d4b6-44dc-8a81-b06cc4e7968a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139236 Nov 28 00:54:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 213/634] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec67af19-1729-43e1-ba13-129c8a46e33f"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:21 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a0ee832f-c3d5-4bbf-aeef-fe2331581ed9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348598 Nov 28 00:54:22 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 217/635] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:54:21 2023] POST /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:54:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-164a5c31-5764-4b5e-af71-2e9a38d7e41e req-3555ded8-058c-4fab-a248-aadf88dac811 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033198 Nov 28 00:54:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 206/636] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:28 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:28 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:29 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-342d56d8-0460-44b6-8f98-83bc7b7e54fc tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1706 microversion: 2.1 time: 0.333143 Nov 28 00:54:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 214/637] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:54:28 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1706 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:29 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6b992a0e-f422-410e-9648-740c7a494375 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1706 microversion: 2.1 time: 0.260894 Nov 28 00:54:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 218/638] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:54:29 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1706 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] [instance: 0fc5430b-5c2a-4074-886e-d53482cb2bb9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=39 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] HTTP exception thrown: Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 could not be found. Nov 28 00:54:32 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Returning 404 to user: Instance 0fc5430b-5c2a-4074-886e-d53482cb2bb9 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:54:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-cb985a5e-ed36-452f-9b2e-d3f98b12297e tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9" status: 404 len: 111 microversion: 2.1 time: 0.029173 Nov 28 00:54:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 207/639] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:54:32 2023] GET /compute/v2.1/servers/0fc5430b-5c2a-4074-886e-d53482cb2bb9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:54:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1f7dc045-ed8e-4e3c-b69d-42f3aa9f929f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] Calling method '.version_select at 0x7f4972f97490>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1f7dc045-ed8e-4e3c-b69d-42f3aa9f929f tempest-SnapshotDataIntegrityTests-1920079985 tempest-SnapshotDataIntegrityTests-1920079985-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-213731965" status: 202 len: 0 microversion: 2.1 time: 0.039397 Nov 28 00:54:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 215/640] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 00:54:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-213731965 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:54:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:33 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-aef43d84-2eec-4085-b43b-576d562ecfa9 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046680 Nov 28 00:54:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 219/641] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:54:33 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:33 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:33 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-5951f2dd-d50b-4dac-997e-f16b1e4f7a2d tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/96cca523-fcec-4118-9da5-3cd8302ca3eb" status: 200 len: 194 microversion: 2.1 time: 0.038604 Nov 28 00:54:33 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 208/642] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 00:54:33 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/96cca523-fcec-4118-9da5-3cd8302ca3eb => generated 194 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:33 user devstack@n-api.service[65277]: DEBUG nova.objects.instance [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'services' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=65277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:54:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2183e42b-9611-4809-b360-0a8cf5b87897 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/96cca523-fcec-4118-9da5-3cd8302ca3eb" status: 202 len: 0 microversion: 2.1 time: 0.165173 Nov 28 00:54:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 216/643] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:54:33 2023] DELETE /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/96cca523-fcec-4118-9da5-3cd8302ca3eb => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:41 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c42f6f52-2cb1-4963-a1b8-7e3d2eab2282 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 200 len: 1716 microversion: 2.1 time: 0.198927 Nov 28 00:54:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 220/644] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:54:41 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 1716 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=13 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=7 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:44 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1c4fe450-b708-45b2-8e31-9c38e45d526d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 200 len: 1378 microversion: 2.1 time: 0.202412 Nov 28 00:54:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 209/645] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:54:43 2023] GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 1378 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=27 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:52 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-b5391759-84d7-4d61-848c-b9bc0d0f2c9b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 200 len: 1767 microversion: 2.87 time: 0.267130 Nov 28 00:54:52 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 217/646] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:54:52 2023] GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 1767 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:54:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-81bf566a-945c-4e35-8455-9a176f6b5956 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.441178 Nov 28 00:54:52 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 221/647] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:54:52 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4/os-interface => generated 282 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19151248-a33d-46b2-be99-0a85a5ab88d3", "tag": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] Creating event network-changed:e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance 19151248-a33d-46b2-be99-0a85a5ab88d3 on user Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-54aa57de-ea86-44a7-b0eb-0a86c2989378 req-acc39af7-fca2-4bac-be21-cde8c5ee8461 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032084 Nov 28 00:54:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 210/648] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:53 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5fb01f83-9e4f-4e6c-976e-0ad82ed4e37e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1428 microversion: 2.1 time: 0.201631 Nov 28 00:54:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 218/649] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:54:53 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1428 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c97d8540-7432-438a-acbd-e15582aaa75e tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.144001 Nov 28 00:54:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 211/650] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 00:54:53 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-interface => generated 282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Old instance type m1.tiny, new instance type m1.small {{(pid=65278) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'cores', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Getting quotas for user f63a0e9261934c8b8e673f069c3376bd and project 22c31829ff0846fc8584d492bea6cdc4. Resources: {'cores', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:54:54 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-01918733-d287-4535-9c58-e2a1d5928a22 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.657294 Nov 28 00:54:54 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 222/651] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:54:53 2023] POST /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:54 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:54 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-3999d926-6db3-4065-a41e-11a1a07a82e9 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1437 microversion: 2.1 time: 0.223387 Nov 28 00:54:54 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 219/652] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:54:54 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1437 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:54:54 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] Creating event network-changed:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:54:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-305671e1-d18e-4416-8ae2-2a6afa4f8307 req-ed66718d-3b0a-41bd-885c-6d216d0dcc61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042641 Nov 28 00:54:54 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 212/653] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:54 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-096d12fa-36a6-48b9-a209-c22bf3c3981a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/ips" status: 200 len: 110 microversion: 2.20 time: 0.036228 Nov 28 00:54:54 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 223/654] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 28 00:54:54 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/ips => generated 110 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 28 00:54:55 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] Creating event network-changed:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:54:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-ecda6c8b-32ad-4e1d-8fb2-304a31ad0db9 req-64cbdbc7-92c7-4d13-9f70-bfb0be851c92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034854 Nov 28 00:54:55 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 220/655] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:54:55 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:55 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:55 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-908477b0-5704-41d5-9c2f-d2f4126a20f0 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/ec67af19-1729-43e1-ba13-129c8a46e33f" status: 200 len: 194 microversion: 2.1 time: 0.044424 Nov 28 00:54:55 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 213/656] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 00:54:55 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/ec67af19-1729-43e1-ba13-129c8a46e33f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:55 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:55 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:56 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lazy-loading 'services' on Instance uuid f480b3d7-0357-4dca-af75-d4cd264f5a2b {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:54:56 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5926ade5-9893-4a0a-a882-83d58b4d5efe tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/ec67af19-1729-43e1-ba13-129c8a46e33f" status: 202 len: 0 microversion: 2.1 time: 0.238381 Nov 28 00:54:56 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 224/657] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:54:55 2023] DELETE /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments/ec67af19-1729-43e1-ba13-129c8a46e33f => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:54:57 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-unplugged", "status": "completed", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}, {"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-plugged", "status": "completed", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:57 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Creating event network-vif-unplugged:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:54:57 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Creating event network-vif-plugged:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:54:57 user devstack@n-api.service[65277]: DEBUG nova.compute.api [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:54:57 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-79ea507c-1cda-46da-bd64-01120efe599b req-2481328d-5730-4197-99d9-701167a8a66c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039490 Nov 28 00:54:57 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 221/658] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:57 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:57 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'flavor' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:54:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-48d2e3d4-65dd-4c9b-89b5-4421e2186d37 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/action" status: 202 len: 0 microversion: 2.20 time: 0.798779 Nov 28 00:54:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 214/659] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 00:54:57 2023] POST /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:58 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:54:58 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7df58061-b2c8-4dd1-8c8b-460410abc63d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 200 len: 1711 microversion: 2.20 time: 0.197640 Nov 28 00:54:58 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 225/660] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:54:58 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 1711 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:54:59 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-unplugged", "status": "completed", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}, {"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-plugged", "status": "completed", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:54:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:54:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:54:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:54:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Creating event network-vif-unplugged:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:54:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] Creating event network-vif-plugged:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:54:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-91bb6543-cf42-4a1e-ad1e-ad2d06049354 req-ce299ede-9b53-4cc9-848c-3ec8d79b62d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.100029 Nov 28 00:54:59 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 222/661] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:54:59 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:04 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:04 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] Creating event network-changed:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:55:04 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-0b5124d2-d661-4ac1-99ad-502276959d5f req-2eb98768-0867-4f17-afb9-3b61432ed8b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032865 Nov 28 00:55:04 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 215/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-plugged", "status": "completed", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:10 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:55:10 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=22 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:55:10 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:55:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Creating event network-vif-plugged:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:55:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65278) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:55:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-d61aecd3-f9ed-4985-a919-136c670e8e63 req-a53cb05e-bd3f-4afb-9780-fb7efc7bf862 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046079 Nov 28 00:55:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 226/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:12 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=14 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:55:12 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=26 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:55:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-plugged", "status": "completed", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Creating event network-vif-plugged:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:55:12 user devstack@n-api.service[65277]: DEBUG nova.compute.api [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65277) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 00:55:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-74163470-9d8a-4cc4-b91b-4f76bd52f254 req-e47ce2f0-b41f-4b5c-981b-08dd53112686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042984 Nov 28 00:55:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 223/664] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=14 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-362df967-6226-44b8-8cf9-3f394e175e18 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047311 Nov 28 00:55:18 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 216/665] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:55:18 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e4205183-f811-4b8e-8b9a-a856c23b909e tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044433 Nov 28 00:55:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 227/666] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:55:19 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:19 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:55:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d3ee69c0-e9cc-4e7e-ae5d-2c166452e292 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b" status: 204 len: 0 microversion: 2.1 time: 0.122741 Nov 28 00:55:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 224/667] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:55:19 2023] DELETE /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:19 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf2b106f48442cd84784a5880737464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf38cc0048d41bfb69a50d55f9c1963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2aa8aec1-7261-46f4-a5b5-75b81f3a1e24 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b" status: 200 len: 1659 microversion: 2.1 time: 0.241998 Nov 28 00:55:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 217/668] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:55:19 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b => generated 1659 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:20 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0254d78c-994c-4661-aa10-4e8dc97519c8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84" status: 200 len: 1536 microversion: 2.1 time: 0.211844 Nov 28 00:55:20 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 228/669] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:55:19 2023] GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84 => generated 1536 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:55:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480b3d7-0357-4dca-af75-d4cd264f5a2b", "name": "network-vif-unplugged", "status": "completed", "tag": "2e30b84a-0f54-4293-95c7-339ccf7e830b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] Creating event network-vif-unplugged:2e30b84a-0f54-4293-95c7-339ccf7e830b for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b on user Nov 28 00:55:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-e4f324ab-bb75-4066-9cb7-7fe21984c74e req-877a9a31-0e36-4e93-9991-d9e5ef8da8c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071692 Nov 28 00:55:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 225/670] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:21 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480b3d7-0357-4dca-af75-d4cd264f5a2b", "name": "network-vif-deleted", "tag": "2e30b84a-0f54-4293-95c7-339ccf7e830b"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:21 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] Creating event network-vif-deleted:2e30b84a-0f54-4293-95c7-339ccf7e830b for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b on user Nov 28 00:55:21 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-37a0eb13-9e02-445b-a2fe-e43fa3dd34ef req-fa9d74ba-7da9-4f2f-817f-154ec90e66ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035533 Nov 28 00:55:21 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 218/671] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3702ef7a-256e-4dbe-9b8c-2980c83ddb84", "tag": "2c602f33-1cb2-4d10-b074-9348e302816a"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] Creating event network-changed:2c602f33-1cb2-4d10-b074-9348e302816a for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 on user Nov 28 00:55:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-e34f88bd-db09-45d2-8d54-3ffb3bee00ff req-92205373-4358-4c3f-9250-771aa3cc8cf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035855 Nov 28 00:55:21 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 229/672] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480b3d7-0357-4dca-af75-d4cd264f5a2b", "name": "network-vif-plugged", "status": "completed", "tag": "2e30b84a-0f54-4293-95c7-339ccf7e830b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] Creating event network-vif-plugged:2e30b84a-0f54-4293-95c7-339ccf7e830b for instance f480b3d7-0357-4dca-af75-d4cd264f5a2b on user Nov 28 00:55:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-b898da0e-7c9a-41ae-a17b-4057a72b118f req-7773a680-a502-4fee-a67a-9140f8b01426 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048779 Nov 28 00:55:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 226/673] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20f2e1ca-37cc-463c-a6d9-51154a0664be"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:22 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1eb15cb6-7ac7-4f01-b29c-c6b76dbd7964 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273950 Nov 28 00:55:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 219/674] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:55:22 2023] POST /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:29 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:55:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b567f349-93de-43f3-b247-772ddf1bb771 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 204 len: 0 microversion: 2.1 time: 0.122202 Nov 28 00:55:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 230/675] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:55:29 2023] DELETE /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:29 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e626332697e34a0ba733c723a5ecb328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57f21cfce3044c5aad7192a64ce2d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4ff8fa1f-86bd-460e-8a96-7efb3ef23910 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 200 len: 1712 microversion: 2.1 time: 0.261599 Nov 28 00:55:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 227/676] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:55:29 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 1712 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:55:30 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-unplugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:30 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:30 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:30 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:30 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] Creating event network-vif-unplugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:55:30 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-8c46c233-29bb-4a7b-b37f-c3f45e427735 req-fd444c47-9064-47ca-9597-48a851f7bc5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041915 Nov 28 00:55:30 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 220/677] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-plugged", "status": "completed", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] Creating event network-vif-plugged:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:55:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4e64df61-89da-46da-88b2-48c4c359821e req-a5186210-574d-468f-8454-72b009b38568 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035384 Nov 28 00:55:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 231/678] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-ee976f5a-fc08-4ae2-a2a1-91b94035d96c req-20b06ffd-2f86-4779-a273-11adc9833edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41828b32-f570-4428-8064-5c199a898a04", "name": "network-vif-deleted", "tag": "9c1755ff-555e-44fa-8082-fceddb0ee343"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ee976f5a-fc08-4ae2-a2a1-91b94035d96c req-20b06ffd-2f86-4779-a273-11adc9833edc service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ee976f5a-fc08-4ae2-a2a1-91b94035d96c req-20b06ffd-2f86-4779-a273-11adc9833edc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ee976f5a-fc08-4ae2-a2a1-91b94035d96c req-20b06ffd-2f86-4779-a273-11adc9833edc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ee976f5a-fc08-4ae2-a2a1-91b94035d96c req-20b06ffd-2f86-4779-a273-11adc9833edc service nova] Creating event network-vif-deleted:9c1755ff-555e-44fa-8082-fceddb0ee343 for instance 41828b32-f570-4428-8064-5c199a898a04 on user Nov 28 00:55:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-ee976f5a-fc08-4ae2-a2a1-91b94035d96c req-20b06ffd-2f86-4779-a273-11adc9833edc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030645 Nov 28 00:55:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 228/679] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:34 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'services' on Instance uuid 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:55:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-283fe41f-6312-4fdc-be4a-f9f04ba82ede tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments/20f2e1ca-37cc-463c-a6d9-51154a0664be" status: 202 len: 0 microversion: 2.1 time: 0.192027 Nov 28 00:55:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 221/680] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:55:34 2023] DELETE /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments/20f2e1ca-37cc-463c-a6d9-51154a0664be => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:55:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:35 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-bc3ab474-b62c-43d5-a9d8-0c923166ca00 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Nov 28 00:55:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 232/681] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:55:35 2023] GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:41 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:42 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-47a9af26-b36c-416b-8d2e-4575f4d53726 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.193141 Nov 28 00:55:42 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 229/682] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:55:41 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-interface => generated 282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] Creating event network-changed:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:55:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ed4f2913-3e67-4aae-b490-079c88a281a5 req-709ae67a-64b6-4cc9-8462-e6cc63c950c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035139 Nov 28 00:55:42 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 222/683] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:43 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lazy-loading 'services' on Instance uuid a835216a-04a1-4660-a458-13cca79489c3 {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:55:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a5f3b4a1-8974-492c-9c76-0fb5d6bb85b9 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments/685d49b1-0ae7-4bd5-8960-edfa41570827" status: 202 len: 0 microversion: 2.1 time: 0.187824 Nov 28 00:55:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 233/684] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:55:43 2023] DELETE /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments/685d49b1-0ae7-4bd5-8960-edfa41570827 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:55:43 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:43 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:43 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-913cb7e7-2a7b-4d80-b9ac-e5d185111718 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053592 Nov 28 00:55:43 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 230/685] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:55:43 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1bd2f7c0-2a3a-4790-a61f-68446dcc7fe0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 200 len: 1378 microversion: 2.1 time: 0.220882 Nov 28 00:55:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 223/686] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:55:44 2023] GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 1378 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f6d5529c-db7c-484a-8819-2673a077e6e0 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 200 len: 1378 microversion: 2.1 time: 0.159771 Nov 28 00:55:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 234/687] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:55:44 2023] GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 1378 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-54385156-9f22-4a03-b04e-2490f7546db2 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1555 microversion: 2.1 time: 0.240127 Nov 28 00:55:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 231/688] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:55:44 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:55:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-71dcf26b-20ba-476e-8153-627e7b750fbf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 204 len: 0 microversion: 2.1 time: 0.123618 Nov 28 00:55:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 224/689] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:55:44 2023] DELETE /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] Creating event network-changed:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:55:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5dc45d18-2f87-474b-bfa4-f2121f0deff9 req-a1a2f714-60b1-4e17-9b76-c198b5a1d7a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053028 Nov 28 00:55:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 232/690] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:44 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:45 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6dc15765-43b3-4f67-b560-e03893d02234 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 200 len: 1384 microversion: 2.1 time: 0.171357 Nov 28 00:55:45 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 235/691] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:55:44 2023] GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 1384 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:55:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-1c26c5fd-41fe-40fe-a360-ebd6e5485ac3 req-62749293-5807-42a6-8c5a-723c755133f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7f368b-5aca-4be6-8844-a207bee693b2", "name": "network-vif-deleted", "tag": "ad4c074f-c4eb-44e5-af60-5d63c0776018"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c26c5fd-41fe-40fe-a360-ebd6e5485ac3 req-62749293-5807-42a6-8c5a-723c755133f3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c26c5fd-41fe-40fe-a360-ebd6e5485ac3 req-62749293-5807-42a6-8c5a-723c755133f3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c26c5fd-41fe-40fe-a360-ebd6e5485ac3 req-62749293-5807-42a6-8c5a-723c755133f3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-1c26c5fd-41fe-40fe-a360-ebd6e5485ac3 req-62749293-5807-42a6-8c5a-723c755133f3 service nova] Creating event network-vif-deleted:ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance 9d7f368b-5aca-4be6-8844-a207bee693b2 on user Nov 28 00:55:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-1c26c5fd-41fe-40fe-a360-ebd6e5485ac3 req-62749293-5807-42a6-8c5a-723c755133f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027663 Nov 28 00:55:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 225/692] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:46 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7f368b-5aca-4be6-8844-a207bee693b2", "name": "network-vif-unplugged", "status": "completed", "tag": "ad4c074f-c4eb-44e5-af60-5d63c0776018"}, {"server_uuid": "9d7f368b-5aca-4be6-8844-a207bee693b2", "name": "network-vif-plugged", "status": "completed", "tag": "ad4c074f-c4eb-44e5-af60-5d63c0776018"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Creating event network-vif-unplugged:ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance 9d7f368b-5aca-4be6-8844-a207bee693b2 on user Nov 28 00:55:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] Creating event network-vif-plugged:ad4c074f-c4eb-44e5-af60-5d63c0776018 for instance 9d7f368b-5aca-4be6-8844-a207bee693b2 on user Nov 28 00:55:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-b915b885-77ba-432f-9b71-d1434311279a req-8732e5bc-b031-4300-9ca8-5a2ac2cd897b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.049572 Nov 28 00:55:47 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 233/693] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:46 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:48 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:48 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-57c8c84a-4179-4f56-bc95-d2b798844c5c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 200 len: 1652 microversion: 2.20 time: 0.195145 Nov 28 00:55:48 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 236/694] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:55:48 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 1652 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "514ac427-1da5-4fb2-9ecc-27393cb575fb"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:52 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lazy-loading 'flavor' on Instance uuid 500f7840-d86c-4620-b93f-9065ebe4872f {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:55:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-a3f50492-45fb-4739-854a-c6ee0877cd95 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f/action" status: 200 len: 29 microversion: 2.87 time: 0.483245 Nov 28 00:55:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 226/695] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 00:55:52 2023] POST /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f/action => generated 29 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:53 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:55:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-3fdc7909-8255-4b1c-9401-f8e84d2bb96b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 200 len: 1773 microversion: 2.87 time: 0.240347 Nov 28 00:55:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 234/696] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:55:53 2023] GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 1773 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:55:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-unplugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] Creating event network-vif-unplugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:55:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-f2d359da-5bfb-4e7a-a50d-f67b5271fca1 req-92f0d0f2-cf9b-460a-b602-d4c7e2b4cdbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033041 Nov 28 00:55:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 237/697] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:55 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:55:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-b3c4a1b2-4df2-4074-a310-6e079ccab780 req-083983e9-a9c9-48ac-bc17-46cc755a5d14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030544 Nov 28 00:55:56 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 227/698] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:55:58 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:55:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:55:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:55:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:55:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:55:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-4108740c-853e-43ac-bc15-c03cbfd57a03 req-164a3eaa-be39-4d92-9417-d779b8c5174b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030237 Nov 28 00:55:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 235/699] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:56:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-60ae6568-f2b6-47b9-9c71-087fc5abbeb3 req-48c7c1be-32bb-4576-91f9-b67871fbfe73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031357 Nov 28 00:56:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 238/700] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HTTP exception thrown: Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b could not be found. Nov 28 00:56:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Returning 404 to user: Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-8241b4ef-4316-4e00-a980-eacdf6f758b2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b" status: 404 len: 111 microversion: 2.1 time: 0.037517 Nov 28 00:56:09 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 228/701] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:09 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:09 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:09 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:09 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ea74d443-2dc0-4012-886f-00626e02763f tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '.version_select at 0x7f4972f96170>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ea74d443-2dc0-4012-886f-00626e02763f tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111325301" status: 202 len: 0 microversion: 2.1 time: 0.034217 Nov 28 00:56:09 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 236/702] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 00:56:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111325301 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:56:16 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HTTP exception thrown: Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b could not be found. Nov 28 00:56:17 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Returning 404 to user: Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-3c4d6b5f-4a60-49fa-a3da-b07d88ab66c2 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b" status: 404 len: 111 microversion: 2.1 time: 0.039595 Nov 28 00:56:17 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 239/703] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:56:16 2023] DELETE /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: f480b3d7-0357-4dca-af75-d4cd264f5a2b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HTTP exception thrown: Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b could not be found. Nov 28 00:56:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Returning 404 to user: Instance f480b3d7-0357-4dca-af75-d4cd264f5a2b could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-743ba114-88e8-4ee2-8462-b6a6c470ca89 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b" status: 404 len: 111 microversion: 2.1 time: 0.027388 Nov 28 00:56:17 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 229/704] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:17 2023] GET /compute/v2.1/servers/f480b3d7-0357-4dca-af75-d4cd264f5a2b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] HTTP exception thrown: Instance 41828b32-f570-4428-8064-5c199a898a04 could not be found. Nov 28 00:56:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Returning 404 to user: Instance 41828b32-f570-4428-8064-5c199a898a04 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-bb180f86-820e-4dd7-9255-3f3397b628ac tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 404 len: 111 microversion: 2.1 time: 0.038764 Nov 28 00:56:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 237/705] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:20 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] HTTP exception thrown: Instance 41828b32-f570-4428-8064-5c199a898a04 could not be found. Nov 28 00:56:20 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Returning 404 to user: Instance 41828b32-f570-4428-8064-5c199a898a04 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e7b77d89-4e04-46db-91bd-e909b6ada71f tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032568 Nov 28 00:56:20 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 240/706] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:56:20 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HTTP exception thrown: Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a could not be found. Nov 28 00:56:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Returning 404 to user: Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-bfcac48f-256b-441f-8116-9947c5853c61 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 404 len: 111 microversion: 2.1 time: 0.033893 Nov 28 00:56:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 230/707] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:56:22 2023] DELETE /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] [instance: 6f7c5378-aadc-45e4-b3c3-d308e526b03a] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] HTTP exception thrown: Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a could not be found. Nov 28 00:56:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] Returning 404 to user: Instance 6f7c5378-aadc-45e4-b3c3-d308e526b03a could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-126869a3-ddcd-4bf2-a9dc-30bfd5121019 tempest-AttachVolumeTestJSON-1794071981 tempest-AttachVolumeTestJSON-1794071981-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a" status: 404 len: 111 microversion: 2.1 time: 0.029002 Nov 28 00:56:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 238/708] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:22 2023] GET /compute/v2.1/servers/6f7c5378-aadc-45e4-b3c3-d308e526b03a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f354a5aa-50ab-449f-8c56-2bd252e406dc tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101201 Nov 28 00:56:25 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 241/709] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:56:25 2023] GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] HTTP exception thrown: Instance 41828b32-f570-4428-8064-5c199a898a04 could not be found. Nov 28 00:56:25 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Returning 404 to user: Instance 41828b32-f570-4428-8064-5c199a898a04 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9c535143-e518-469d-b244-1aeb5a881ba3 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 404 len: 111 microversion: 2.1 time: 0.029286 Nov 28 00:56:25 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 231/710] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:56:25 2023] DELETE /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] [instance: 41828b32-f570-4428-8064-5c199a898a04] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] HTTP exception thrown: Instance 41828b32-f570-4428-8064-5c199a898a04 could not be found. Nov 28 00:56:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Returning 404 to user: Instance 41828b32-f570-4428-8064-5c199a898a04 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-a72fce1d-e0c4-46fe-81c0-0fa44a7e7dd8 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04" status: 404 len: 111 microversion: 2.1 time: 0.046687 Nov 28 00:56:25 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 239/711] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:25 2023] GET /compute/v2.1/servers/41828b32-f570-4428-8064-5c199a898a04 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:25 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ed949a26-f1d2-4435-9a9e-bc3bf2fc6dd5 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] Calling method '.version_select at 0x7f497357b2e0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ed949a26-f1d2-4435-9a9e-bc3bf2fc6dd5 tempest-ServerActionsTestOtherB-1824523225 tempest-ServerActionsTestOtherB-1824523225-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863538692" status: 202 len: 0 microversion: 2.1 time: 0.032252 Nov 28 00:56:25 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 242/712] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 00:56:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863538692 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:56:28 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-235061251"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:28 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:29 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-7f85ec19-d695-4412-8937-e13b1b70d0b3 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/action" status: 202 len: 0 microversion: 2.1 time: 1.041094 Nov 28 00:56:29 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 232/713] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:56:28 2023] POST /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/action => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d609e363-4580-4ed2-8b19-ad7c502fadf0 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050894 Nov 28 00:56:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 240/714] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:56:33 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:33 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:56:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-31139bd7-2ff5-4461-bc95-115130dbf961 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 204 len: 0 microversion: 2.1 time: 0.128650 Nov 28 00:56:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 243/715] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:56:33 2023] DELETE /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-unplugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:33 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-bee7b74e-4dcf-4401-be40-fdffcccfbcaf tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 200 len: 1676 microversion: 2.1 time: 0.253791 Nov 28 00:56:33 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 233/716] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:33 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 1676 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:56:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] Creating event network-vif-unplugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:56:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-b8b3fa4d-3261-4821-9acf-f51eb05b49c8 req-2a5dfafd-db7c-4a51-9ddd-cac53626edeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038329 Nov 28 00:56:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 241/717] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 9d7f368b-5aca-4be6-8844-a207bee693b2 could not be found. Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 9d7f368b-5aca-4be6-8844-a207bee693b2 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-495b5b58-ff0c-49cc-b1ef-5dee3789010f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 404 len: 111 microversion: 2.1 time: 0.029356 Nov 28 00:56:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 244/718] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:35 2023] GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 9d7f368b-5aca-4be6-8844-a207bee693b2 could not be found. Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 9d7f368b-5aca-4be6-8844-a207bee693b2 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-4fa6bdaa-4e64-41d1-aa58-231570ee7389 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 404 len: 111 microversion: 2.1 time: 0.031361 Nov 28 00:56:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 234/719] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:56:35 2023] DELETE /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 9d7f368b-5aca-4be6-8844-a207bee693b2] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-deleted", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 9d7f368b-5aca-4be6-8844-a207bee693b2 could not be found. Nov 28 00:56:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 9d7f368b-5aca-4be6-8844-a207bee693b2 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:56:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-3da7f810-5ea8-4fc3-80b2-e9a21ab5f5be tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2" status: 404 len: 111 microversion: 2.1 time: 0.027881 Nov 28 00:56:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 242/720] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:35 2023] GET /compute/v2.1/servers/9d7f368b-5aca-4be6-8844-a207bee693b2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] Creating event network-vif-deleted:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:56:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-92e69176-f093-461b-ad48-aaa651780a7f req-f0b762e7-5904-4891-ab70-bc2d58fcd2e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034163 Nov 28 00:56:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 245/721] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a835216a-04a1-4660-a458-13cca79489c3", "name": "network-vif-plugged", "status": "completed", "tag": "2df0bea2-3afd-4093-909a-2d0026656990"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] Creating event network-vif-plugged:2df0bea2-3afd-4093-909a-2d0026656990 for instance a835216a-04a1-4660-a458-13cca79489c3 on user Nov 28 00:56:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-bf22bde3-e0e6-4c4b-b2e2-e68e98e4a23c req-c0f972a8-5258-4987-96c7-6bb94dc12a1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038239 Nov 28 00:56:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 235/722] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-293111776", "imageRef": "d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce", "flavorRef": "1", "key_name": "tempest-TestStampPattern-1933151860", "security_groups": [{"name": "tempest-secgroup-smoke-295838016"}], "networks": [{"uuid": "d65f0111-ef66-4c05-8da0-00fdbf788b0b"}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:36 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] validate_networks() for [('d65f0111-ef66-4c05-8da0-00fdbf788b0b', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting quotas for project 7a6914d589cc40088c765d5ae8fdd28c. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Getting quotas for user 725ae105f36b4b1ca7422d6237a51ff8 and project 7a6914d589cc40088c765d5ae8fdd28c. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:56:37 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d15c809e-06d1-4bc6-8fd6-e0a2440ce2ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:56:37 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-301f3c42-c083-4093-a31f-00470be59be4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.174105 Nov 28 00:56:37 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 243/723] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:56:36 2023] POST /compute/v2.1/servers => generated 403 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:56:37 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9ab4a344-b05a-401e-b892-6ce5f9dacd82 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:37 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-9ab4a344-b05a-401e-b892-6ce5f9dacd82 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:37 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-9ab4a344-b05a-401e-b892-6ce5f9dacd82 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:37 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-9ab4a344-b05a-401e-b892-6ce5f9dacd82 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f" status: 200 len: 1234 microversion: 2.1 time: 0.075125 Nov 28 00:56:37 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 246/724] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:37 2023] GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f => generated 1234 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:56:39 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-3bb57158-4b02-411f-822d-03a3fa1cd4cf tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: .version_select at 0x7f4973061900>, body: {"keypair": {"name": "tempest-keypair-252894268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeZt2c9UtUtkeVXNTbEsNnGhqm4avOEQ1pdSt7qFI0J5O6ZC6D5QO2RZxaZiPLGAmw7hczfNEUrO1u72wTxnAm0JRO1bulIV8lOW7aQQfrmLSKDWcAsr/0HLEYoQkjksA=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:39 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-3bb57158-4b02-411f-822d-03a3fa1cd4cf tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:56:39 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-3bb57158-4b02-411f-822d-03a3fa1cd4cf tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for user 6692115b7e8042c38fb8ecb84a5af250 and project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:56:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-3bb57158-4b02-411f-822d-03a3fa1cd4cf tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171852 Nov 28 00:56:39 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 236/725] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:56:39 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2decc79-0682-4b5a-a9e1-84c0738bc32f", "tag": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] Creating event network-changed:43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f on user Nov 28 00:56:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-e1242ffb-564f-4836-a8f2-963e05320952 req-42b9a51e-91a0-431a-91bb-ef99277a3c4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036418 Nov 28 00:56:41 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 244/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:42 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-960895983", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "17b52fdf-8b78-4226-b39e-12aa8c2e462a"}], "security_groups": [{"name": "tempest-securitygroup--299405270"}], "key_name": "tempest-keypair-252894268", "user_data": "}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:42 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] validate_networks() for [('17b52fdf-8b78-4226-b39e-12aa8c2e462a', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for user 6692115b7e8042c38fb8ecb84a5af250 and project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:56:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5be07a8f-d0ec-47c1-a9db-a3a4e030c7e2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.027841 Nov 28 00:56:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 247/727] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:56:42 2023] POST /compute/v2.1/servers => generated 399 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:56:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2dedb35d-36e0-47cb-ac7f-4a67483bc104 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:43 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2dedb35d-36e0-47cb-ac7f-4a67483bc104 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:43 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-2dedb35d-36e0-47cb-ac7f-4a67483bc104 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2dedb35d-36e0-47cb-ac7f-4a67483bc104 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e" status: 200 len: 1232 microversion: 2.1 time: 0.066264 Nov 28 00:56:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 237/728] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:43 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e => generated 1232 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:43 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:43 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7235653f-3818-446f-a154-467338431003 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 200 len: 1753 microversion: 2.87 time: 0.325703 Nov 28 00:56:43 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 245/729] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:56:43 2023] GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 1753 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2decc79-0682-4b5a-a9e1-84c0738bc32f", "name": "network-vif-plugged", "status": "completed", "tag": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] Creating event network-vif-plugged:43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f on user Nov 28 00:56:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-82677938-2611-4a87-bc18-9bdc0ed2be4b req-ada422c6-7715-4897-974b-b4ab4a959ddc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065230 Nov 28 00:56:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 248/730] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:44 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:44 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2f3a9c2d-6974-419b-8e22-eb6ab0c68a3f tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4/action" status: 204 len: 0 microversion: 2.1 time: 0.083869 Nov 28 00:56:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 238/731] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:56:44 2023] POST /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:56:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:44 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:45 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:45 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5ff05d43-2c50-47b9-91bb-cacc2985b11e tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1555 microversion: 2.1 time: 0.454111 Nov 28 00:56:45 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 246/732] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:44 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1555 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:56:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2decc79-0682-4b5a-a9e1-84c0738bc32f", "name": "network-vif-plugged", "status": "completed", "tag": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] Creating event network-vif-plugged:43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f on user Nov 28 00:56:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-0d2708a7-cb18-45f3-a689-2d2c7be3c7d6 req-ea1bf1a9-294b-4552-9af4-9111dbde8f25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041650 Nov 28 00:56:46 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 249/733] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e92c4084-ae1d-4bc3-9e1d-c1bf9791ec0e tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: .version_select at 0x7f4973061480>, body: {"keypair": {"name": "tempest-keypair-1686178802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtyUkCqD8pOggg2Myig6/PxeFuXzVrScmiQGk1GNq655YfB3ezMyrTbEbh1XsSEcaMceoI1hkpBeejJxOYffgKCKnxu64nQXQgSVZbspfqDypBUIlH0YUYe3s5Z+oWPcw=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:46 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-e92c4084-ae1d-4bc3-9e1d-c1bf9791ec0e tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:56:46 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-e92c4084-ae1d-4bc3-9e1d-c1bf9791ec0e tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:56:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e92c4084-ae1d-4bc3-9e1d-c1bf9791ec0e tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121683 Nov 28 00:56:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 239/734] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:56:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:48 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b22014-115e-4871-8dfa-dd14d4c2312e", "tag": "265df925-6615-406d-8c78-0de24d0d6812"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:48 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:48 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:56:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:48 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] Creating event network-changed:265df925-6615-406d-8c78-0de24d0d6812 for instance f0b22014-115e-4871-8dfa-dd14d4c2312e on user Nov 28 00:56:48 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-63210788-0141-43df-a98c-ecc8ccab850d req-9553d4d2-b252-4a6b-9f82-895edd58870a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037186 Nov 28 00:56:48 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 247/735] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1208451470", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "6a269223-5c71-46b2-a411-719bb3f3c390", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e7a9c673-be29-4f27-b00a-34793dbf68b7"}], "security_groups": [{"name": "tempest-securitygroup--744215756"}], "key_name": "tempest-keypair-1686178802", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] validate_networks() for [('e7a9c673-be29-4f27-b00a-34793dbf68b7', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:56:48 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c389382-3b17-46cd-8da9-1a19d1c2ebf6"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:56:48 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:48 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:49 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:49 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b22014-115e-4871-8dfa-dd14d4c2312e", "name": "network-vif-plugged", "status": "completed", "tag": "265df925-6615-406d-8c78-0de24d0d6812"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:49 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:49 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:49 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:56:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] Creating event network-vif-plugged:265df925-6615-406d-8c78-0de24d0d6812 for instance f0b22014-115e-4871-8dfa-dd14d4c2312e on user Nov 28 00:56:49 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:56:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5d0d8068-2828-4639-b694-a96ee2a42187 req-c8542b6d-987d-4d17-8e61-2588d098e842 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090069 Nov 28 00:56:49 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 248/736] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:56:49 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:56:49 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a269223-5c71-46b2-a411-719bb3f3c390',volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:56:49 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f78252a3-ed32-4782-902a-c9740921ffa8 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.053411 Nov 28 00:56:49 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 250/737] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:56:48 2023] POST /compute/v2.1/servers => generated 403 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:56:49 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-a8821fad-4077-4b64-a19b-005a75042386 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:49 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-a8821fad-4077-4b64-a19b-005a75042386 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:49 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-a8821fad-4077-4b64-a19b-005a75042386 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:49 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-a8821fad-4077-4b64-a19b-005a75042386 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f" status: 200 len: 1088 microversion: 2.1 time: 0.092161 Nov 28 00:56:49 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 249/738] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:56:49 2023] GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f => generated 1088 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:56:49 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-aa4af9d8-a42c-4354-8822-36e268082187 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.885247 Nov 28 00:56:49 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 240/739] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 00:56:48 2023] POST /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments => generated 188 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:50 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65278) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 00:56:50 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-01e2a6be-886b-4976-acd9-515ff6440c78 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/action" status: 202 len: 0 microversion: 2.20 time: 0.165320 Nov 28 00:56:50 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 251/740] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 00:56:50 2023] POST /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:50 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:56:50 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6e061a92-66cf-48a3-9da8-6bdf526b39b0 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 200 len: 1738 microversion: 2.20 time: 0.240197 Nov 28 00:56:50 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 250/741] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:56:50 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:56:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b22014-115e-4871-8dfa-dd14d4c2312e", "name": "network-vif-plugged", "status": "completed", "tag": "265df925-6615-406d-8c78-0de24d0d6812"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] Creating event network-vif-plugged:265df925-6615-406d-8c78-0de24d0d6812 for instance f0b22014-115e-4871-8dfa-dd14d4c2312e on user Nov 28 00:56:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-6e7955c1-fe9f-46a8-842d-2925740d73fd req-7e56179a-a9c3-468a-b107-364201df9564 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043027 Nov 28 00:56:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 241/742] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:56:52 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ee17b8-1169-4f2d-95ff-74eaf625f96f", "tag": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:56:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:56:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:56:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:56:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] Creating event network-changed:ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f on user Nov 28 00:56:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-c9064c7f-a1b8-46c2-a382-a9c4e07ba493 req-64cb44c0-c340-4038-b35b-8c6687bc8f48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036406 Nov 28 00:56:52 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 252/743] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:56:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:00 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:00 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:00 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=42 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] Creating event network-changed:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:57:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-41cd2915-2ab0-4636-900b-0d70ae803822 req-70bc7b3c-2cac-4575-991c-f43d77d2f02d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107842 Nov 28 00:57:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 251/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:02 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=10 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:02 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:02 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ee17b8-1169-4f2d-95ff-74eaf625f96f", "name": "network-vif-plugged", "status": "completed", "tag": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] Creating event network-vif-plugged:ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f on user Nov 28 00:57:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-a8b21eb6-6711-40d9-8fc1-f8d3151d1fdb req-4e16e581-9f14-44ad-a544-3dd61b15b1e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308573 Nov 28 00:57:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 242/745] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:04 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:04 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=14 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:04 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:04 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:04 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ee17b8-1169-4f2d-95ff-74eaf625f96f", "name": "network-vif-plugged", "status": "completed", "tag": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:04 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:04 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] Creating event network-vif-plugged:ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f on user Nov 28 00:57:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-cde73eb6-0ecc-41e5-a620-a5df1948c01f req-f33950b8-377e-4180-8068-8ca09b0e1529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048594 Nov 28 00:57:05 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 253/746] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-plugged", "status": "completed", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] Creating event network-vif-plugged:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:57:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-70de44df-570e-4654-abe4-2c29138b7817 req-e307ce3d-37ba-4d11-a66a-a454eabf53de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065756 Nov 28 00:57:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 252/747] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-plugged", "status": "completed", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] Creating event network-vif-plugged:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:57:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-09c6916b-c2e9-4656-a936-fa0a798187a8 req-1239c33e-4cec-46aa-b993-7f0209d0b0bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Nov 28 00:57:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 243/748] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: a835216a-04a1-4660-a458-13cca79489c3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] HTTP exception thrown: Instance a835216a-04a1-4660-a458-13cca79489c3 could not be found. Nov 28 00:57:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Returning 404 to user: Instance a835216a-04a1-4660-a458-13cca79489c3 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:57:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-1a056424-d10a-4ad7-abce-41acf265d493 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3" status: 404 len: 111 microversion: 2.1 time: 0.064638 Nov 28 00:57:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 254/749] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:57:23 2023] GET /compute/v2.1/servers/a835216a-04a1-4660-a458-13cca79489c3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:57:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-63a932a0-9c37-4600-943b-cf7bd6092bed tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '.version_select at 0x7f4972f96a70>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:24 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:24 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-63a932a0-9c37-4600-943b-cf7bd6092bed tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986818562" status: 202 len: 0 microversion: 2.1 time: 0.038702 Nov 28 00:57:24 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 253/750] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 00:57:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986818562 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:28 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c06f50ca-0b71-4eb4-a308-e1195aa5a5ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f" status: 200 len: 1536 microversion: 2.1 time: 0.270199 Nov 28 00:57:28 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 244/751] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:57:27 2023] GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f => generated 1536 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:31 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:57:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-889be2f7-a2c4-4554-a40d-3000b25e69c8 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f" status: 204 len: 0 microversion: 2.1 time: 0.140381 Nov 28 00:57:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 255/752] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:57:31 2023] DELETE /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2bd0f67c-b7d4-49cc-90ea-1441a9cb54b4 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f" status: 200 len: 1494 microversion: 2.1 time: 0.235427 Nov 28 00:57:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 254/753] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:57:32 2023] GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f => generated 1494 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:57:32 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-unplugged", "status": "completed", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] Creating event network-vif-unplugged:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:57:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-e91776af-3b60-4ea5-ac48-ca06f4b0ae96 req-5889eb52-fec3-43cd-af37-aa1c56c199b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039117 Nov 28 00:57:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 245/754] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-6d415485-631c-4ecf-9f60-e88a569f9510 req-68757fea-1803-436b-9b0d-983f4ba0b9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-deleted", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6d415485-631c-4ecf-9f60-e88a569f9510 req-68757fea-1803-436b-9b0d-983f4ba0b9bd service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6d415485-631c-4ecf-9f60-e88a569f9510 req-68757fea-1803-436b-9b0d-983f4ba0b9bd service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6d415485-631c-4ecf-9f60-e88a569f9510 req-68757fea-1803-436b-9b0d-983f4ba0b9bd service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-6d415485-631c-4ecf-9f60-e88a569f9510 req-68757fea-1803-436b-9b0d-983f4ba0b9bd service nova] Creating event network-vif-deleted:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:57:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-6d415485-631c-4ecf-9f60-e88a569f9510 req-68757fea-1803-436b-9b0d-983f4ba0b9bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209999 Nov 28 00:57:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 256/755] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:33 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e3958f82-bf55-4ba3-8ba6-311988c243e6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e" status: 200 len: 1540 microversion: 2.1 time: 0.262057 Nov 28 00:57:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 255/756] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:57:33 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e => generated 1540 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:57:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f32bed1-593f-4bf4-ba26-9496d83fc17f", "name": "network-vif-plugged", "status": "completed", "tag": "625efbe6-4ffa-44c8-90e8-3bb69f390dbb"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] Creating event network-vif-plugged:625efbe6-4ffa-44c8-90e8-3bb69f390dbb for instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f on user Nov 28 00:57:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-f5dbae1b-042d-4a30-899c-f20a394321db req-af244cf1-38c5-4aa8-998b-7c98e5b8d97c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Nov 28 00:57:34 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 246/757] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:35 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-d8aec828-a08a-4045-bcab-61b58b788ddc tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1547 microversion: 2.1 time: 0.314361 Nov 28 00:57:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 257/758] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:57:35 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1547 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:39 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-afe287ee-0357-43d7-b751-db750d946fdf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f" status: 200 len: 1441 microversion: 2.1 time: 0.221589 Nov 28 00:57:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 256/759] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:57:39 2023] GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f => generated 1441 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:40 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:40 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f6e14afc-6ec5-4a6d-9058-337f7e6599e6 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 200 len: 1783 microversion: 2.20 time: 0.199172 Nov 28 00:57:40 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 247/760] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:57:40 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 1783 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:57:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:43 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7f5ba281-5502-4e0a-b7ff-8f72baf6c2f9 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "POST /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f/action" status: 202 len: 0 microversion: 2.87 time: 0.073490 Nov 28 00:57:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 258/761] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 00:57:43 2023] POST /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:44 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:57:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-416fb43f-2829-471e-a6a8-e73458a34366 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 200 len: 1761 microversion: 2.87 time: 0.237695 Nov 28 00:57:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 257/762] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:57:44 2023] GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 1761 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:57:44 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-unplugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] Creating event network-vif-unplugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:57:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-a62c39db-bfda-4424-9eba-72b1db3a1a82 req-0c8377d6-6b64-49f2-8e10-4773cb750a61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029077 Nov 28 00:57:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 248/763] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}, {"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:57:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:57:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-81481ce8-ab68-4536-8bad-55753dacafd1 req-fe2fa61e-b84f-44ca-9ad0-a707d11fae2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049209 Nov 28 00:57:46 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 259/764] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:57:48 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:57:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:57:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:57:48 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:57:48 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:57:48 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-61c3ab4a-ee2b-4db2-804d-ab11760e2f6f req-a78b494a-c560-421e-856d-81f687dd9cf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030681 Nov 28 00:57:48 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 258/765] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:57:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:10 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=10 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:10 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=18 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9d27ae45-b153-4b62-af69-1bc38d26fa09 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Action: 'create', calling method: .version_select at 0x7f4972e58ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2097820211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2KNQqJEkWGmzZifPUVaLA75cWARw0qE/b2TEuxTimAKA+NMfhXs8WJnpbDfmPzdEvNU0XTfO37MxPtD+1IFavGk4iz1iq94AyP1MZC1OnuSEjEHHqIHb9E/bv4urgRBw=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:10 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-9d27ae45-b153-4b62-af69-1bc38d26fa09 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Getting quotas for project 42084ccfd4f3455f976a532e4dbf19f7. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:58:10 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-9d27ae45-b153-4b62-af69-1bc38d26fa09 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Getting quotas for user cbce18d8a1ce4e25a7ba0043f40a3a71 and project 42084ccfd4f3455f976a532e4dbf19f7. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:58:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9d27ae45-b153-4b62-af69-1bc38d26fa09 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.264944 Nov 28 00:58:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 249/766] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:58:10 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:16 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:16 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2056787703", "imageRef": "", "flavorRef": "1", "key_name": "tempest-TestShelveInstance-2097820211", "security_groups": [{"name": "tempest-secgroup-smoke-169695386"}], "networks": [{"uuid": "30e73ff5-31d7-4a4c-a96a-32e79774110e"}], "block_device_mapping_v2": [{"uuid": "3fa07cbb-69f4-4464-8f9a-a752bde8d39b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:16 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] validate_networks() for [('30e73ff5-31d7-4a4c-a96a-32e79774110e', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Getting quotas for project 42084ccfd4f3455f976a532e4dbf19f7. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Getting quotas for user cbce18d8a1ce4e25a7ba0043f40a3a71 and project 42084ccfd4f3455f976a532e4dbf19f7. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:58:17 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fa07cbb-69f4-4464-8f9a-a752bde8d39b',volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:58:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-143048ff-0c7a-4c39-8689-ea37cb190b97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.782351 Nov 28 00:58:17 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 260/767] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:58:16 2023] POST /compute/v2.1/servers => generated 403 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 28 00:58:17 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:17 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=26 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:17 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-9ad98e15-aa3c-4bae-a2d1-f2bd058ea078 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:17 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-9ad98e15-aa3c-4bae-a2d1-f2bd058ea078 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:17 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-9ad98e15-aa3c-4bae-a2d1-f2bd058ea078 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:17 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-9ad98e15-aa3c-4bae-a2d1-f2bd058ea078 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 200 len: 1082 microversion: 2.1 time: 0.074939 Nov 28 00:58:17 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 259/768] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:17 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 1082 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:58:20 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] Creating event network-changed:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 00:58:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-cb6a3391-7a2b-46f9-bf86-465bdef0fd91 req-50b08777-014c-4870-9add-7e0acebc99f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030850 Nov 28 00:58:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 250/769] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: 3f32bed1-593f-4bf4-ba26-9496d83fc17f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] HTTP exception thrown: Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f could not be found. Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Returning 404 to user: Instance 3f32bed1-593f-4bf4-ba26-9496d83fc17f could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:58:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b28902e1-7080-4d1d-88c8-5c335bdaf814 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f" status: 404 len: 111 microversion: 2.1 time: 0.132447 Nov 28 00:58:22 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 261/770] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:22 2023] GET /compute/v2.1/servers/3f32bed1-593f-4bf4-ba26-9496d83fc17f => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:22 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:58:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-56c40f95-ce6b-451f-a2e0-1f967189b37d tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 204 len: 0 microversion: 2.1 time: 0.208194 Nov 28 00:58:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 260/771] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:58:22 2023] DELETE /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-unplugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:22 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aad5a4c6583f42b39eda624923ded77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e8c7ba7df64471b83fbfb45237c8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-5803c3c9-a67a-40ee-8b1f-46d0c5fab527 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 200 len: 1508 microversion: 2.1 time: 0.216294 Nov 28 00:58:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 251/772] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:22 2023] GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:58:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] Creating event network-vif-unplugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:58:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-5fba62f2-467b-4e59-88b8-12733cddf817 req-92386ec9-57c2-4e3b-92da-092393222c4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031899 Nov 28 00:58:22 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 262/773] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-cacb261b-71e7-4b95-9095-5a9c42b33b37 req-f4a1e114-ca68-4558-b261-8a6d658bfb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-deleted", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-cacb261b-71e7-4b95-9095-5a9c42b33b37 req-f4a1e114-ca68-4558-b261-8a6d658bfb14 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-cacb261b-71e7-4b95-9095-5a9c42b33b37 req-f4a1e114-ca68-4558-b261-8a6d658bfb14 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-cacb261b-71e7-4b95-9095-5a9c42b33b37 req-f4a1e114-ca68-4558-b261-8a6d658bfb14 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-cacb261b-71e7-4b95-9095-5a9c42b33b37 req-f4a1e114-ca68-4558-b261-8a6d658bfb14 service nova] Creating event network-vif-deleted:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:58:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-cacb261b-71e7-4b95-9095-5a9c42b33b37 req-f4a1e114-ca68-4558-b261-8a6d658bfb14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039172 Nov 28 00:58:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 261/774] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:24 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-unplugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}, {"server_uuid": "bf245d26-e901-4fca-8ff5-a3558974294b", "name": "network-vif-plugged", "status": "completed", "tag": "5d492cfb-25b6-4b28-b279-bd2f648c39f3"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:58:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:58:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:58:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Creating event network-vif-unplugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:58:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] Creating event network-vif-plugged:5d492cfb-25b6-4b28-b279-bd2f648c39f3 for instance bf245d26-e901-4fca-8ff5-a3558974294b on user Nov 28 00:58:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-34735f55-b36a-45e7-8144-524e2c1393e4 req-0d03c7bb-aa5a-471c-9d4b-f42eb01c8514 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031959 Nov 28 00:58:24 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 252/775] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:24 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:28 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:28 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c5173275-13bf-4d91-8c09-a85f63cfd9d4 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f" status: 200 len: 1536 microversion: 2.1 time: 0.505300 Nov 28 00:58:28 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 263/776] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:28 2023] GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f => generated 1536 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:58:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-plugged", "status": "completed", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] Creating event network-vif-plugged:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 00:58:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-b9ad44c3-ad42-46e2-8b97-af34874a94f7 req-0c138bf5-ef4f-404d-9531-5f7a67b2b0cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138375 Nov 28 00:58:30 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 262/777] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5864536-2d1a-4694-8028-caab90d64b23"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-bf49bf4a-50a0-420a-abaa-865c58f803c9 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473132 Nov 28 00:58:31 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 253/778] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:58:31 2023] POST /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f/os-volume_attachments => generated 194 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-plugged", "status": "completed", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}, {"name": "network-changed", "server_uuid": "a2decc79-0682-4b5a-a9e1-84c0738bc32f", "tag": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Creating event network-vif-plugged:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 00:58:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] Creating event network-changed:43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f on user Nov 28 00:58:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-dc4fdfc4-0857-4704-a8b3-333f10a491bd req-d5a3348f-5ca3-4393-bf6a-4aa58357b43e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043710 Nov 28 00:58:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 264/779] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:32 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:33 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6d93e821-8ee5-4a54-bbf9-7e9410ac1b34 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.158545 Nov 28 00:58:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 263/780] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:58:33 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-interface => generated 282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:34 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-cb2854b6-3f6f-4f0c-a8e4-64fdf99b3a96 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 200 len: 1767 microversion: 2.87 time: 0.365291 Nov 28 00:58:34 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 254/781] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:58:34 2023] GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 1767 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:58:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0b22014-115e-4871-8dfa-dd14d4c2312e", "tag": "265df925-6615-406d-8c78-0de24d0d6812"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] Creating event network-changed:265df925-6615-406d-8c78-0de24d0d6812 for instance f0b22014-115e-4871-8dfa-dd14d4c2312e on user Nov 28 00:58:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-b75a5446-641e-4050-a9ad-e7c1ae92dd0e req-175b6a9c-b445-4b20-8e38-7064cf05ddd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040725 Nov 28 00:58:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 265/782] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:35 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-59553109-140f-4e10-ab51-2b1307ba72bc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/ips" status: 200 len: 107 microversion: 2.1 time: 0.041438 Nov 28 00:58:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 264/783] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 00:58:35 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/ips => generated 107 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:35 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:36 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-60e55cb2-450c-4c64-b5c4-ef72d9ac20f7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1547 microversion: 2.1 time: 0.387858 Nov 28 00:58:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 255/784] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:35 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1547 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:58:36 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:36 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b8e80ca3-509a-4e61-8b87-5860caa50f91 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4/action" status: 200 len: 32341 microversion: 2.1 time: 0.270631 Nov 28 00:58:36 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 266/785] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:58:36 2023] POST /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4/action => generated 32341 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:36 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ae623186-aed7-4f75-b624-e60dda74e899 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1541 microversion: 2.1 time: 0.240254 Nov 28 00:58:36 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 265/786] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:36 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1541 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:58:37 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89fef214-9301-4d77-bb3e-cdfa422e83de"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:37 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-79207e2c-c651-44ed-9f54-5d8d4e621b13 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304067 Nov 28 00:58:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 256/787] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 00:58:37 2023] POST /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:39 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:39 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b18a43ac-517c-4fe2-bf6b-0c5e8c8bf201 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.202115 Nov 28 00:58:39 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 267/788] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 00:58:39 2023] GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f/os-interface => generated 283 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ee17b8-1169-4f2d-95ff-74eaf625f96f", "tag": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] Creating event network-changed:ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f on user Nov 28 00:58:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-35cc49e1-7154-431c-8094-0e3fb0ce13ef req-18ac6c24-3810-4a06-99da-a62c20a62b4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037260 Nov 28 00:58:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 266/789] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:40 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:40 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-cf518df7-57d6-4ac8-bf99-d56beecf68a9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f" status: 200 len: 1441 microversion: 2.1 time: 0.235821 Nov 28 00:58:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 257/790] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:40 2023] GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f => generated 1441 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2145695423"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-538ba608-a7a3-4073-9972-876ff8e32530 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments/5c389382-3b17-46cd-8da9-1a19d1c2ebf6" status: 200 len: 194 microversion: 2.20 time: 0.190699 Nov 28 00:58:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 268/791] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Nov 28 00:58:40 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments/5c389382-3b17-46cd-8da9-1a19d1c2ebf6 => generated 194 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:58:41 user devstack@n-api.service[65277]: INFO nova.compute.api [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Attempting to quiesce instance before volume snapshot. Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65277]: INFO nova.compute.api [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 28 00:58:41 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'services' on Instance uuid 5fcab10a-4f5f-479c-9d0c-907bcea7d87e {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:58:41 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Creating snapshot from volume 6a269223-5c71-46b2-a411-719bb3f3c390. {{(pid=65277) snapshot_instance /opt/stack/nova/nova/compute/api.py:3512}} Nov 28 00:58:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d6edda27-d534-4fc6-b4c3-fbab03cb3c1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments/5c389382-3b17-46cd-8da9-1a19d1c2ebf6" status: 202 len: 0 microversion: 2.20 time: 0.598644 Nov 28 00:58:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 258/792] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 00:58:41 2023] DELETE /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments/5c389382-3b17-46cd-8da9-1a19d1c2ebf6 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-3af445e1-4db9-4272-af55-f9c9078530a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048929 Nov 28 00:58:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 269/793] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 00:58:41 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 00:58:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:43 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:44 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-73e366d0-513d-418c-9db3-f5e0871fa014 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f/action" status: 202 len: 0 microversion: 2.1 time: 3.013746 Nov 28 00:58:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 267/794] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 00:58:41 2023] POST /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f/action => generated 0 bytes in 3021 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 00:58:44 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lazy-loading 'services' on Instance uuid a2decc79-0682-4b5a-a9e1-84c0738bc32f {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 00:58:44 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-554e10fd-2460-4f4b-9864-c26c80d07c5b tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f/os-volume_attachments/c5864536-2d1a-4694-8028-caab90d64b23" status: 202 len: 0 microversion: 2.1 time: 0.236821 Nov 28 00:58:44 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 259/795] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 00:58:43 2023] DELETE /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f/os-volume_attachments/c5864536-2d1a-4694-8028-caab90d64b23 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 00:58:44 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:44 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:44 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:44 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-eb3e2ee9-1d78-4911-9a15-89b2d0cd1a57 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049831 Nov 28 00:58:44 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 270/796] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:58:44 2023] GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:45 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6ede8122-5eaf-4950-8e7f-08f1395356ce tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: .version_select at 0x7f4972ffb370>, body: {"keypair": {"name": "tempest-keypair-755313768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy1apJVpf98tjT3O9I7ncn5SN4dSBHY9Yj0vxMq6JMtxNahVKM1GH5RAuf8kRxS9rGJGRcunlLXZQQV0rfE2RW5xi41ldPgN0diD7Q+JsGAeuRkXhRJQUBTPVe25N4gcQ=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:45 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-6ede8122-5eaf-4950-8e7f-08f1395356ce tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:58:45 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-6ede8122-5eaf-4950-8e7f-08f1395356ce tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:58:45 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6ede8122-5eaf-4950-8e7f-08f1395356ce tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.100940 Nov 28 00:58:45 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 268/797] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:58:45 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1947899743", "imageRef": "c147252c-f6ee-4636-bb61-7d559394663a", "flavorRef": "1", "networks": [{"uuid": "e7a9c673-be29-4f27-b00a-34793dbf68b7"}], "security_groups": [{"name": "tempest-securitygroup--219571902"}], "key_name": "tempest-keypair-755313768", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] validate_networks() for [('e7a9c673-be29-4f27-b00a-34793dbf68b7', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:58:47 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6d135966-e923-43cd-91eb-a9024285fe1e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:58:47 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1ad7c27a-8194-463f-83ab-105d4d555ddc tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.685308 Nov 28 00:58:47 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 260/798] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:58:46 2023] POST /compute/v2.1/servers => generated 403 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:58:47 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-2aaeda5b-2315-48ff-a86d-765ccc83171d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:47 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-2aaeda5b-2315-48ff-a86d-765ccc83171d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:47 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-2aaeda5b-2315-48ff-a86d-765ccc83171d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:47 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-2aaeda5b-2315-48ff-a86d-765ccc83171d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" status: 200 len: 1245 microversion: 2.1 time: 0.070092 Nov 28 00:58:47 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 271/799] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:47 2023] GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:58:48 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-14cb2272-fbaa-465f-9693-b162f42257ac tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: .version_select at 0x7f4972f95120>, body: {"keypair": {"name": "tempest-keypair-509848427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATSpAopraW6cNHBCbcsQ7cRNBLTfzxnb3VVz6xYSxROk9zSsm8WrrtUdXPXyVFQd/08QBbchhzBNuPIdsQS1cS6wTd+5XTV6jLa4pMhL3tQfjQwEyy4G4ybftgCqIf3aw=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:48 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-14cb2272-fbaa-465f-9693-b162f42257ac tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:58:48 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-14cb2272-fbaa-465f-9693-b162f42257ac tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for user 6692115b7e8042c38fb8ecb84a5af250 and project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:58:48 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-14cb2272-fbaa-465f-9693-b162f42257ac tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048763 Nov 28 00:58:48 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 269/800] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 00:58:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:50 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20", "tag": "f19fff11-b050-4a94-9fad-1bdb14c14f72"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] Creating event network-changed:f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 on user Nov 28 00:58:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-53fd0e0d-bee3-4960-a1fa-cbbbe56e138d req-8b031b98-4a52-430d-8f00-698b3c66d094 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039290 Nov 28 00:58:50 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 261/801] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:50 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-625351436", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "17b52fdf-8b78-4226-b39e-12aa8c2e462a"}], "security_groups": [{"name": "tempest-securitygroup--843447406"}], "key_name": "tempest-keypair-509848427", "user_data": "}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] validate_networks() for [('17b52fdf-8b78-4226-b39e-12aa8c2e462a', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for user 6692115b7e8042c38fb8ecb84a5af250 and project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:58:51 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:58:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e5b53c22-9b38-4ff7-a840-a2ad5ecae5a4 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.709163 Nov 28 00:58:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 272/802] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:58:50 2023] POST /compute/v2.1/servers => generated 399 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:58:51 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d660ce7e-a17c-4489-8d37-34efcd268502 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:58:51 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d660ce7e-a17c-4489-8d37-34efcd268502 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:58:51 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:58:51 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-d660ce7e-a17c-4489-8d37-34efcd268502 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:58:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d660ce7e-a17c-4489-8d37-34efcd268502 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" status: 200 len: 1232 microversion: 2.1 time: 0.099857 Nov 28 00:58:51 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 270/803] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:58:51 2023] GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c => generated 1232 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:58:54 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c", "tag": "403dbea6-2bda-4b17-9d20-e17ae32d6e73"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] Creating event network-changed:403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c on user Nov 28 00:58:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-90654a02-b9d0-40ac-9055-c9c90488cd55 req-cc8db6a3-946e-49bf-bbb1-6303947bf144 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039236 Nov 28 00:58:54 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 262/804] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:56 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c", "name": "network-vif-plugged", "status": "completed", "tag": "403dbea6-2bda-4b17-9d20-e17ae32d6e73"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:56 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] Creating event network-vif-plugged:403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c on user Nov 28 00:58:56 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-59b14a10-a68c-48f5-b76c-2b99fffc4156 req-bfb37474-ae70-4181-a194-049ace803c73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039565 Nov 28 00:58:56 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 273/805] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:58:58 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c", "name": "network-vif-plugged", "status": "completed", "tag": "403dbea6-2bda-4b17-9d20-e17ae32d6e73"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:58:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:58:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:58:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:58:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] Creating event network-vif-plugged:403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c on user Nov 28 00:58:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0d971fd8-05ea-4d3a-8d6c-a00882e681ae req-53dcaabc-732e-43e2-952d-4d64256c2a7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041126 Nov 28 00:58:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 271/806] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:05 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:05 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:05 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:05 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20", "name": "network-vif-plugged", "status": "completed", "tag": "f19fff11-b050-4a94-9fad-1bdb14c14f72"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] Creating event network-vif-plugged:f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 on user Nov 28 00:59:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-4d54ae29-2fe3-4ae6-a378-559d743f541e req-390f63e6-0306-4fc1-a6fe-55c03fca089d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037012 Nov 28 00:59:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 263/807] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=46 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:07 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c7458fe8-2994-4f7a-8350-e375b7948169 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 200 len: 1432 microversion: 2.1 time: 0.234532 Nov 28 00:59:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 274/808] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:59:07 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 1432 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:59:07 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=10 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20", "name": "network-vif-plugged", "status": "completed", "tag": "f19fff11-b050-4a94-9fad-1bdb14c14f72"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] Creating event network-vif-plugged:f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 on user Nov 28 00:59:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-54182a7d-6c34-4c77-92e1-536de8c7d9fc req-c75512b6-747a-4477-aa0b-75485f8f93e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035374 Nov 28 00:59:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 272/809] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] [instance: bf245d26-e901-4fca-8ff5-a3558974294b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] HTTP exception thrown: Instance bf245d26-e901-4fca-8ff5-a3558974294b could not be found. Nov 28 00:59:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] Returning 404 to user: Instance bf245d26-e901-4fca-8ff5-a3558974294b could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 00:59:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-399ae4dc-fa37-4af9-8b99-152add049f14 tempest-ServerRescueNegativeTestJSON-1136436756 tempest-ServerRescueNegativeTestJSON-1136436756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b" status: 404 len: 111 microversion: 2.1 time: 0.035219 Nov 28 00:59:13 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 264/810] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:59:13 2023] GET /compute/v2.1/servers/bf245d26-e901-4fca-8ff5-a3558974294b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1401399961", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "860d6281-89e3-48fc-9050-984da4b55006"}]}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] validate_networks() for [('860d6281-89e3-48fc-9050-984da4b55006', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Getting quotas for project eaf19f7d462f4fa2a9204479d1d35811. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Getting quotas for user 8679237c178f427a9cc7887c21fe12cf and project eaf19f7d462f4fa2a9204479d1d35811. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 00:59:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 00:59:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-2e944ebf-8a0e-464c-8d62-a8657b14e3fa tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.563743 Nov 28 00:59:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 275/811] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 00:59:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 00:59:23 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:23 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-8e2f2c5d-d38e-43d1-ba15-b786872ed2ee tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:23 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-8e2f2c5d-d38e-43d1-ba15-b786872ed2ee tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:23 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-8e2f2c5d-d38e-43d1-ba15-b786872ed2ee tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-8e2f2c5d-d38e-43d1-ba15-b786872ed2ee tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 200 len: 1209 microversion: 2.1 time: 0.075965 Nov 28 00:59:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 273/812] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:59:23 2023] GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 1209 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:59:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b375c38b-e368-4e2a-b988-0ae27130a878", "tag": "cbe5cb94-844b-4115-a79a-e58beb743d42"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:26 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:26 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] Creating event network-changed:cbe5cb94-844b-4115-a79a-e58beb743d42 for instance b375c38b-e368-4e2a-b988-0ae27130a878 on user Nov 28 00:59:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-dcdd2f26-0d04-424e-a19a-d17e9feec506 req-3c6c81db-6d6a-4731-b8d4-411f073129cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030414 Nov 28 00:59:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 265/813] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:28 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b375c38b-e368-4e2a-b988-0ae27130a878", "name": "network-vif-plugged", "status": "completed", "tag": "cbe5cb94-844b-4115-a79a-e58beb743d42"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:28 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] Creating event network-vif-plugged:cbe5cb94-844b-4115-a79a-e58beb743d42 for instance b375c38b-e368-4e2a-b988-0ae27130a878 on user Nov 28 00:59:28 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-66b9d4a6-35fb-4a54-8496-cbe5186d5fe1 req-8b4d79ff-92f2-45e7-a571-b097f23d1db1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047855 Nov 28 00:59:28 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 276/814] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b375c38b-e368-4e2a-b988-0ae27130a878", "name": "network-vif-plugged", "status": "completed", "tag": "cbe5cb94-844b-4115-a79a-e58beb743d42"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] Creating event network-vif-plugged:cbe5cb94-844b-4115-a79a-e58beb743d42 for instance b375c38b-e368-4e2a-b988-0ae27130a878 on user Nov 28 00:59:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-7827731a-b4a6-4726-8b95-bafc50ed5851 req-203e9e66-65ef-4ea9-a04b-4548e660c8f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046467 Nov 28 00:59:30 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 274/815] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-8226eda9-9e86-4d02-a60f-a9d5eb80951f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048276 Nov 28 00:59:31 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 266/816] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 00:59:31 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:32 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:59:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-734b9296-6763-4bfa-8921-700a9e8e0194 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 204 len: 0 microversion: 2.20 time: 0.160496 Nov 28 00:59:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 277/817] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:59:32 2023] DELETE /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:32 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-45fc11f1-794f-480b-8025-62d2a31d2b11 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 200 len: 1711 microversion: 2.20 time: 0.263829 Nov 28 00:59:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 275/818] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:59:32 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 1711 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:59:32 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-unplugged", "status": "completed", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] Creating event network-vif-unplugged:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:59:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-8d28dc9d-56a7-49d3-a6f2-ec855359e6a0 req-f764f755-087b-4c8a-a1d4-2ca9b847a7d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030732 Nov 28 00:59:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 267/819] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b2a25830-cf0e-41c8-9578-4a17f14ec2ec tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060839 Nov 28 00:59:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 278/820] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 00:59:34 2023] GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 00:59:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-plugged", "status": "completed", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}, {"server_uuid": "5fcab10a-4f5f-479c-9d0c-907bcea7d87e", "name": "network-vif-deleted", "tag": "ea295632-a11a-4926-b87a-c3fda4b47a47"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:34 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 00:59:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Creating event network-vif-plugged:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:59:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] Creating event network-vif-deleted:ea295632-a11a-4926-b87a-c3fda4b47a47 for instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e on user Nov 28 00:59:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-3574ca07-fe7e-43d2-8b23-2bbefca7aaaa req-c31b4d5d-f445-4d8b-84bb-caff2fcc2530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045349 Nov 28 00:59:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 276/821] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:34 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:59:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d9000706-ad50-4c11-99f7-84c2756e0861 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 204 len: 0 microversion: 2.87 time: 0.151096 Nov 28 00:59:34 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 268/822] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 00:59:34 2023] DELETE /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-602ad331-e4ed-48bc-962b-ac247e646859 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 200 len: 1773 microversion: 2.87 time: 0.366107 Nov 28 00:59:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 279/823] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 00:59:34 2023] GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 1773 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2decc79-0682-4b5a-a9e1-84c0738bc32f", "tag": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] Creating event network-changed:43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f on user Nov 28 00:59:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-a0794f71-b218-424c-a168-ca40e554c002 req-9dc4721f-1e36-470a-b32f-8740c06ff66a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036972 Nov 28 00:59:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 269/824] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:35 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:59:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1555d5ed-8f21-4e40-8659-4d51feea5ca6 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f" status: 204 len: 0 microversion: 2.1 time: 0.159776 Nov 28 00:59:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 277/825] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:59:35 2023] DELETE /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:36 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-74d98c3a-8040-4498-b9af-991ae1f3eed1 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f" status: 200 len: 1661 microversion: 2.1 time: 0.536129 Nov 28 00:59:36 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 280/826] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:59:35 2023] GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f => generated 1661 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:59:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-unplugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}, {"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-plugged", "status": "completed", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}, {"server_uuid": "a2decc79-0682-4b5a-a9e1-84c0738bc32f", "name": "network-vif-unplugged", "status": "completed", "tag": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb"}, {"server_uuid": "a2decc79-0682-4b5a-a9e1-84c0738bc32f", "name": "network-vif-plugged", "status": "completed", "tag": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Creating event network-vif-unplugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:59:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Creating event network-vif-plugged:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:59:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Creating event network-vif-unplugged:43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f on user Nov 28 00:59:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] Creating event network-vif-plugged:43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f on user Nov 28 00:59:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-9a9c66da-0ccc-4f1e-9a1a-46f2e26a24fe req-d00787e5-743c-408d-8784-2010b5edb84e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.035959 Nov 28 00:59:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 270/827] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:36 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2decc79-0682-4b5a-a9e1-84c0738bc32f", "name": "network-vif-deleted", "tag": "43845fb0-ef5f-465a-81d7-41ae84e3a7eb"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] Creating event network-vif-deleted:43845fb0-ef5f-465a-81d7-41ae84e3a7eb for instance a2decc79-0682-4b5a-a9e1-84c0738bc32f on user Nov 28 00:59:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-96b1c237-7db8-4759-8794-a043486c95d4 req-b43fefaf-9d52-4eec-9aa3-958fb59c1ab0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030918 Nov 28 00:59:36 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 278/828] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:37 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 00:59:37 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-2832bcde-c95d-4ee0-8f5b-9ae711cac1e3 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 204 len: 0 microversion: 2.1 time: 0.189448 Nov 28 00:59:37 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 281/829] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 00:59:37 2023] DELETE /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:37 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:37 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-99e7c048-76df-49be-a472-a9240c8f5f37 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 200 len: 1553 microversion: 2.1 time: 0.301546 Nov 28 00:59:37 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 271/830] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:59:37 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:59:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:37 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:38 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-cab0a389-fa32-43e7-8c67-383494793398 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" status: 200 len: 1598 microversion: 2.1 time: 0.309937 Nov 28 00:59:38 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 279/831] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:59:37 2023] GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 => generated 1598 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 00:59:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500f7840-d86c-4620-b93f-9065ebe4872f", "name": "network-vif-deleted", "tag": "4b85a0a3-79a9-4e29-9559-5d25b03f7db5"}, {"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-unplugged", "status": "completed", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}, {"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-plugged", "status": "completed", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Creating event network-vif-deleted:4b85a0a3-79a9-4e29-9559-5d25b03f7db5 for instance 500f7840-d86c-4620-b93f-9065ebe4872f on user Nov 28 00:59:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Creating event network-vif-unplugged:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:59:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] Creating event network-vif-plugged:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:59:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-59532384-9ca4-4e52-8a06-9a404db87fb0 req-a07a10b8-5f72-45f2-8462-666da48a53f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.049380 Nov 28 00:59:38 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 282/832] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:38 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:39 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-3a9d981f-99b6-44b8-8def-3a2d247819b0 req-44981aea-2d1b-4f89-8e17-8bfd9c39e422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08844c7b-f7ca-4c50-ac58-eccff6064ec4", "name": "network-vif-deleted", "tag": "2f437b2e-0b70-4d62-8011-839cbc9a06bb"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 00:59:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3a9d981f-99b6-44b8-8def-3a2d247819b0 req-44981aea-2d1b-4f89-8e17-8bfd9c39e422 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3a9d981f-99b6-44b8-8def-3a2d247819b0 req-44981aea-2d1b-4f89-8e17-8bfd9c39e422 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3a9d981f-99b6-44b8-8def-3a2d247819b0 req-44981aea-2d1b-4f89-8e17-8bfd9c39e422 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-3a9d981f-99b6-44b8-8def-3a2d247819b0 req-44981aea-2d1b-4f89-8e17-8bfd9c39e422 service nova] Creating event network-vif-deleted:2f437b2e-0b70-4d62-8011-839cbc9a06bb for instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 on user Nov 28 00:59:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-3a9d981f-99b6-44b8-8def-3a2d247819b0 req-44981aea-2d1b-4f89-8e17-8bfd9c39e422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073204 Nov 28 00:59:39 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 272/833] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 00:59:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 00:59:41 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 00:59:42 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ea314d02-494b-4929-96fb-39183a1bf42e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" status: 200 len: 1541 microversion: 2.1 time: 0.209324 Nov 28 00:59:42 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 280/834] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 00:59:41 2023] GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c => generated 1541 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:08 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-3c7c1c43-dbde-4e3f-8345-6d60a80331c5 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 200 len: 1432 microversion: 2.1 time: 0.238277 Nov 28 01:00:08 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 283/835] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:07 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 1432 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] Creating event network-changed:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:00:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-df5d0b93-4b40-412f-b6ac-41bdc9a3bda5 req-b98b384c-d40a-4911-973b-591978d4d16c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045537 Nov 28 01:00:09 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 273/836] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:10 user devstack@n-api.service[65277]: DEBUG nova.objects.instance [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lazy-loading 'flavor' on Instance uuid 1e61e82c-a198-4f76-a2b8-84b3c58be36d {{(pid=65277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:00:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7ee1b0fa-fa94-4dce-be49-a5320bbeb53c tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d/action" status: 202 len: 0 microversion: 2.1 time: 0.118235 Nov 28 01:00:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 281/837] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:00:10 2023] POST /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:10 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-1e1695a3-3c9f-420d-bf52-332272888eed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 200 len: 1557 microversion: 2.1 time: 0.219255 Nov 28 01:00:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 284/838] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:10 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:11 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-unplugged", "status": "completed", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}, {"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-plugged", "status": "completed", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Creating event network-vif-unplugged:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:00:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] Creating event network-vif-plugged:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:00:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-e5da0baa-31f0-4939-834f-d25f1b02b439 req-b4681a6c-1e0e-482a-86c2-a1ff2747330b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028116 Nov 28 01:00:11 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 274/839] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:11 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] Creating event network-changed:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:00:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-039d1cab-1c76-4c84-bf9e-49387ee62a5b req-3d33db8d-0498-4866-a164-9d881dd76dd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030191 Nov 28 01:00:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 282/840] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:14 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-74f64afd-e3a2-49ac-a250-a519bffec371 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 200 len: 1491 microversion: 2.1 time: 0.324183 Nov 28 01:00:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 285/841] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:14 2023] GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 1491 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] HTTP exception thrown: Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e could not be found. Nov 28 01:00:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Returning 404 to user: Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:00:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-229c4d46-d5cc-4216-88d6-a0405bf72b45 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 404 len: 111 microversion: 2.20 time: 0.040448 Nov 28 01:00:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 275/842] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:00:22 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:00:22 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:22 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ac32d118-84ad-4ec6-b788-63cc059d406f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '.version_select at 0x7f4972ff8820>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ac32d118-84ad-4ec6-b788-63cc059d406f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702320399" status: 204 len: 0 microversion: 2.20 time: 0.029887 Nov 28 01:00:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 283/843] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 01:00:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702320399 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 01:00:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-44194eb8-1736-4a5f-a843-d3f1edd0ec1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'create', calling method: .version_select at 0x7f497357b2e0>, body: {"keypair": {"name": "tempest-keypair-1399423202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOoiDu67tR7mPD4Ahv+EVZUaBKP+XiaC7SnbsuKk5Kg2EZdBaWQrDdK48Zxa29VqFkJ235tL35fWdJopN9ifTRlqKpakxgM0g7GrZpLW8OW5tlrTl4wl5Xg24x+8AWTJA=="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-44194eb8-1736-4a5f-a843-d3f1edd0ec1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting quotas for project 52c236f1599d4a4fb181b4aa73058211. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:00:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-44194eb8-1736-4a5f-a843-d3f1edd0ec1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting quotas for user 1fd50f4f867e4efcad9e16d45dde6df0 and project 52c236f1599d4a4fb181b4aa73058211. Resources: {'key_pairs'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:00:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-44194eb8-1736-4a5f-a843-d3f1edd0ec1f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049897 Nov 28 01:00:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 286/844] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 01:00:23 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 01:00:24 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-229525217", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "e1a22e53-570e-48e3-97d1-6913705b3f8b"}], "security_groups": [{"name": "tempest-securitygroup--581478237"}], "key_name": "tempest-keypair-1399423202", "user_data": "}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:24 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] validate_networks() for [('e1a22e53-570e-48e3-97d1-6913705b3f8b', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting quotas for project 52c236f1599d4a4fb181b4aa73058211. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Getting quotas for user 1fd50f4f867e4efcad9e16d45dde6df0 and project 52c236f1599d4a4fb181b4aa73058211. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:00:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f250db86-e74e-467f-b441-48d0282cbf08 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.534725 Nov 28 01:00:25 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 276/845] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 01:00:24 2023] POST /compute/v2.1/servers => generated 399 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b22ec0f7-b41c-4b18-b047-4544f59f3e31 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-b22ec0f7-b41c-4b18-b047-4544f59f3e31 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b22ec0f7-b41c-4b18-b047-4544f59f3e31 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b22ec0f7-b41c-4b18-b047-4544f59f3e31 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b22ec0f7-b41c-4b18-b047-4544f59f3e31 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-b22ec0f7-b41c-4b18-b047-4544f59f3e31 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 200 len: 1273 microversion: 2.20 time: 0.071746 Nov 28 01:00:25 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 284/846] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:00:25 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 1273 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=18 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 500f7840-d86c-4620-b93f-9065ebe4872f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] HTTP exception thrown: Instance 500f7840-d86c-4620-b93f-9065ebe4872f could not be found. Nov 28 01:00:25 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Returning 404 to user: Instance 500f7840-d86c-4620-b93f-9065ebe4872f could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:00:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-8ccf85d7-54bb-436b-ab5d-bc85ddde32ff tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f" status: 404 len: 111 microversion: 2.87 time: 0.033532 Nov 28 01:00:25 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 287/847] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:00:25 2023] GET /compute/v2.1/servers/500f7840-d86c-4620-b93f-9065ebe4872f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:00:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-cff1a82d-b240-452a-94b4-c4edfa79e744 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9" status: 204 len: 0 microversion: 2.87 time: 0.161716 Nov 28 01:00:25 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 277/848] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 01:00:25 2023] DELETE /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:26 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: a2decc79-0682-4b5a-a9e1-84c0738bc32f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:26 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:26 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-94389ea2-c7a8-4e7f-a14b-efd7f93d2ba6 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9" status: 200 len: 1697 microversion: 2.87 time: 0.368443 Nov 28 01:00:26 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 285/849] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:00:25 2023] GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9 => generated 1697 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:00:26 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] HTTP exception thrown: Instance a2decc79-0682-4b5a-a9e1-84c0738bc32f could not be found. Nov 28 01:00:26 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Returning 404 to user: Instance a2decc79-0682-4b5a-a9e1-84c0738bc32f could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:00:26 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7bd7e8f1-4f7c-4dac-bd6d-f1138b84381a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f" status: 404 len: 111 microversion: 2.1 time: 0.027712 Nov 28 01:00:26 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 288/850] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:26 2023] GET /compute/v2.1/servers/a2decc79-0682-4b5a-a9e1-84c0738bc32f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:00:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c9b82c-581e-4e29-8d34-286a293a33f9", "name": "network-vif-unplugged", "status": "completed", "tag": "1137e441-e2d4-4e41-b478-54485b3612f7"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] Creating event network-vif-unplugged:1137e441-e2d4-4e41-b478-54485b3612f7 for instance a5c9b82c-581e-4e29-8d34-286a293a33f9 on user Nov 28 01:00:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-b50c4c11-47c7-4152-b923-549f70d5dda1 req-779229cc-ab1c-41cd-ae7c-8778f3fdd8a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037861 Nov 28 01:00:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 278/851] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-eacf9c6e-2147-4a51-b691-516ef4c80ca8 req-528468e5-fab5-42bd-bf91-e8cf63b058f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c9b82c-581e-4e29-8d34-286a293a33f9", "name": "network-vif-deleted", "tag": "1137e441-e2d4-4e41-b478-54485b3612f7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-eacf9c6e-2147-4a51-b691-516ef4c80ca8 req-528468e5-fab5-42bd-bf91-e8cf63b058f0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-eacf9c6e-2147-4a51-b691-516ef4c80ca8 req-528468e5-fab5-42bd-bf91-e8cf63b058f0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-eacf9c6e-2147-4a51-b691-516ef4c80ca8 req-528468e5-fab5-42bd-bf91-e8cf63b058f0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-eacf9c6e-2147-4a51-b691-516ef4c80ca8 req-528468e5-fab5-42bd-bf91-e8cf63b058f0 service nova] Creating event network-vif-deleted:1137e441-e2d4-4e41-b478-54485b3612f7 for instance a5c9b82c-581e-4e29-8d34-286a293a33f9 on user Nov 28 01:00:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-eacf9c6e-2147-4a51-b691-516ef4c80ca8 req-528468e5-fab5-42bd-bf91-e8cf63b058f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072826 Nov 28 01:00:27 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 286/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:27 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HTTP exception thrown: Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 could not be found. Nov 28 01:00:27 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Returning 404 to user: Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:00:27 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-1f57aedf-9995-4903-8157-32703e548245 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 404 len: 111 microversion: 2.1 time: 0.030982 Nov 28 01:00:27 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 289/853] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:27 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:27 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HTTP exception thrown: Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 could not be found. Nov 28 01:00:27 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Returning 404 to user: Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:00:27 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-83a5e9fa-aac2-4d7e-935a-41d5cc3bb804 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 404 len: 111 microversion: 2.1 time: 0.026120 Nov 28 01:00:27 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 279/854] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:00:27 2023] DELETE /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 08844c7b-f7ca-4c50-ac58-eccff6064ec4] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HTTP exception thrown: Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 could not be found. Nov 28 01:00:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Returning 404 to user: Instance 08844c7b-f7ca-4c50-ac58-eccff6064ec4 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:00:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-af42f1be-8f22-4ac5-9035-d8b2d18753a7 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4" status: 404 len: 111 microversion: 2.1 time: 0.046873 Nov 28 01:00:27 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 287/855] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:27 2023] GET /compute/v2.1/servers/08844c7b-f7ca-4c50-ac58-eccff6064ec4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:00:28 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:28 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] Creating event network-changed:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:00:28 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-439a7c72-e1c2-4e24-8041-8c6e318d3e85 req-bb6a983a-8b5a-428e-8cd4-563e2663a04b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060875 Nov 28 01:00:28 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 290/856] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:28 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c9b82c-581e-4e29-8d34-286a293a33f9", "name": "network-vif-plugged", "status": "completed", "tag": "1137e441-e2d4-4e41-b478-54485b3612f7"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] Creating event network-vif-plugged:1137e441-e2d4-4e41-b478-54485b3612f7 for instance a5c9b82c-581e-4e29-8d34-286a293a33f9 on user Nov 28 01:00:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-d9c27252-ea55-453f-aee0-145891efd34b req-580e12ff-8c26-4f4d-89ab-681a0d5ed32f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031204 Nov 28 01:00:28 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 280/857] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-plugged", "status": "completed", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] Creating event network-vif-plugged:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:00:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-401f169f-e183-47f0-98ec-49498722ae09 req-05a959f1-af7f-461e-a140-4165fd0241c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046442 Nov 28 01:00:30 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 288/858] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:32 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:00:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-4d3414e7-652d-4bd4-becb-a00bdb4ce81b tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 204 len: 0 microversion: 2.1 time: 0.121197 Nov 28 01:00:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 291/859] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:00:32 2023] DELETE /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:32 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f63a0e9261934c8b8e673f069c3376bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22c31829ff0846fc8584d492bea6cdc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-77f09993-188e-46b9-bb2d-f011ac87c662 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 200 len: 1547 microversion: 2.1 time: 0.184744 Nov 28 01:00:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 281/860] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:32 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-plugged", "status": "completed", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] Creating event network-vif-plugged:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:00:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-3b7afc5e-b829-4172-9f1a-da750c21b07e req-0c585e68-b016-4f2a-86ce-549489a831e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031013 Nov 28 01:00:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 289/861] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] HTTP exception thrown: Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 is not attached to volume 20f2e1ca-37cc-463c-a6d9-51154a0664be Nov 28 01:00:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Returning 404 to user: Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 is not attached to volume 20f2e1ca-37cc-463c-a6d9-51154a0664be {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:00:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ab920ddc-41c0-431d-b433-a7ace4f1ad5a tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments/20f2e1ca-37cc-463c-a6d9-51154a0664be" status: 404 len: 154 microversion: 2.1 time: 0.106631 Nov 28 01:00:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 292/862] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:00:33 2023] DELETE /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84/os-volume_attachments/20f2e1ca-37cc-463c-a6d9-51154a0664be => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:00:33 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19151248-a33d-46b2-be99-0a85a5ab88d3", "name": "network-vif-unplugged", "status": "completed", "tag": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] Creating event network-vif-unplugged:e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance 19151248-a33d-46b2-be99-0a85a5ab88d3 on user Nov 28 01:00:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-5b4947cf-64d5-463a-92eb-15101d685df6 req-860b8e4d-72d9-4400-bbd4-68a2ae553cbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035330 Nov 28 01:00:33 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 282/863] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:33 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:00:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-f1ac1050-a52a-4a8c-bf69-21078de3a417 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84" status: 204 len: 0 microversion: 2.1 time: 0.148849 Nov 28 01:00:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 290/864] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:00:33 2023] DELETE /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:34 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '725ae105f36b4b1ca7422d6237a51ff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6914d589cc40088c765d5ae8fdd28c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7fb235fa-2e71-488a-8437-77f1d59796fd tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84" status: 200 len: 1661 microversion: 2.1 time: 0.279389 Nov 28 01:00:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 293/865] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:34 2023] GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84 => generated 1661 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3702ef7a-256e-4dbe-9b8c-2980c83ddb84", "tag": "2c602f33-1cb2-4d10-b074-9348e302816a"}, {"server_uuid": "19151248-a33d-46b2-be99-0a85a5ab88d3", "name": "network-vif-deleted", "tag": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Creating event network-changed:2c602f33-1cb2-4d10-b074-9348e302816a for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 on user Nov 28 01:00:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] Creating event network-vif-deleted:e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance 19151248-a33d-46b2-be99-0a85a5ab88d3 on user Nov 28 01:00:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ae6f61a2-0723-4bb0-beec-c88bd23a16b1 req-292d526e-ecf9-4b02-8b3e-6fbd4e5171ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043110 Nov 28 01:00:34 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 283/866] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19151248-a33d-46b2-be99-0a85a5ab88d3", "name": "network-vif-plugged", "status": "completed", "tag": "e6fc4f41-e0f9-4d3e-9361-e29c116e19ef"}, {"server_uuid": "3702ef7a-256e-4dbe-9b8c-2980c83ddb84", "name": "network-vif-unplugged", "status": "completed", "tag": "2c602f33-1cb2-4d10-b074-9348e302816a"}, {"server_uuid": "3702ef7a-256e-4dbe-9b8c-2980c83ddb84", "name": "network-vif-plugged", "status": "completed", "tag": "2c602f33-1cb2-4d10-b074-9348e302816a"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:35 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Creating event network-vif-plugged:e6fc4f41-e0f9-4d3e-9361-e29c116e19ef for instance 19151248-a33d-46b2-be99-0a85a5ab88d3 on user Nov 28 01:00:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Creating event network-vif-unplugged:2c602f33-1cb2-4d10-b074-9348e302816a for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 on user Nov 28 01:00:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] Creating event network-vif-plugged:2c602f33-1cb2-4d10-b074-9348e302816a for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 on user Nov 28 01:00:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-fba1ab45-6570-49c1-bc35-e5d4e2437880 req-631e8985-fea6-4cb6-9771-fc15a5fbc3dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040440 Nov 28 01:00:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 291/867] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:35 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3702ef7a-256e-4dbe-9b8c-2980c83ddb84", "name": "network-vif-deleted", "tag": "2c602f33-1cb2-4d10-b074-9348e302816a"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] Creating event network-vif-deleted:2c602f33-1cb2-4d10-b074-9348e302816a for instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 on user Nov 28 01:00:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-f339c8a2-3842-40ad-b0a8-2afc298dc887 req-bd8726cc-d569-430b-9cc8-25d4c50bf683 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030519 Nov 28 01:00:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 294/868] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-23fc5cc6-4114-442f-bf3f-feca6044de55 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.152704 Nov 28 01:00:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 284/869] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:00:38 2023] GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20/os-interface => generated 283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20", "tag": "f19fff11-b050-4a94-9fad-1bdb14c14f72"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] Creating event network-changed:f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 on user Nov 28 01:00:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-4cdbe31f-41be-4d80-a123-99d84170e5ad req-47e12bd8-0ca6-40dc-b05a-00dbbf802902 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031914 Nov 28 01:00:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 292/870] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:39 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-20f50830-c19f-4cb5-b324-74658391b507 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" status: 200 len: 1598 microversion: 2.1 time: 0.194438 Nov 28 01:00:39 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 295/871] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:39 2023] GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 => generated 1598 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:39 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:00:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-feaf2f83-d7f4-4a01-a2d6-5a68ad282e8d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" status: 204 len: 0 microversion: 2.1 time: 0.111137 Nov 28 01:00:39 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 285/872] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:00:39 2023] DELETE /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:39 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-9c2f22a7-a813-433d-aa7a-d0a1280435f7 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" status: 200 len: 1723 microversion: 2.1 time: 0.232533 Nov 28 01:00:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 293/873] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:39 2023] GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20", "name": "network-vif-unplugged", "status": "completed", "tag": "f19fff11-b050-4a94-9fad-1bdb14c14f72"}, {"server_uuid": "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20", "name": "network-vif-plugged", "status": "completed", "tag": "f19fff11-b050-4a94-9fad-1bdb14c14f72"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Creating event network-vif-unplugged:f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 on user Nov 28 01:00:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] Creating event network-vif-plugged:f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 on user Nov 28 01:00:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-9a3f978a-d371-4933-927c-45a31135c533 req-51dc90aa-7a00-4eaf-b3fd-c460f290c2a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029564 Nov 28 01:00:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 296/874] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20", "name": "network-vif-deleted", "tag": "f19fff11-b050-4a94-9fad-1bdb14c14f72"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] Creating event network-vif-deleted:f19fff11-b050-4a94-9fad-1bdb14c14f72 for instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 on user Nov 28 01:00:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ad126172-5513-4a80-9305-659f563c4364 req-df57bed3-7408-498b-9a4a-b6b2c62ba5d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038304 Nov 28 01:00:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 286/875] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:42 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:42 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:42 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:42 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c7433d3f-ce76-461a-a9da-b8c95a7564a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.210141 Nov 28 01:00:42 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 294/876] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:00:42 2023] GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/os-interface => generated 283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-76b9c724-9381-4794-b98b-5b25d3c2735d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/ips" status: 200 len: 108 microversion: 2.1 time: 0.038419 Nov 28 01:00:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 297/877] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 01:00:43 2023] GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/ips => generated 108 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89fef214-9301-4d77-bb3e-cdfa422e83de"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Invalid volume: volume 89fef214-9301-4d77-bb3e-cdfa422e83de is already attached to instances: f0b22014-115e-4871-8dfa-dd14d4c2312e Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 400 to user: Invalid volume: volume 89fef214-9301-4d77-bb3e-cdfa422e83de is already attached to instances: f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:00:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1fb13191-2bf4-4131-998f-edb5f437dbc8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110715 Nov 28 01:00:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 287/878] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:00:43 2023] POST /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c", "tag": "403dbea6-2bda-4b17-9d20-e17ae32d6e73"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] Creating event network-changed:403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c on user Nov 28 01:00:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-861a7e6b-97c5-4dc1-ab43-1e9b4f85ccdb req-950b62fe-5815-42ee-ad2c-6f90f105e557 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035501 Nov 28 01:00:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 298/879] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:43 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-59d4dc05-683c-4f72-baa8-f2b28137ea7c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" status: 204 len: 0 microversion: 2.1 time: 0.135723 Nov 28 01:00:43 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 295/880] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:00:43 2023] DELETE /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c", "name": "network-vif-unplugged", "status": "completed", "tag": "403dbea6-2bda-4b17-9d20-e17ae32d6e73"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] Creating event network-vif-unplugged:403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c on user Nov 28 01:00:43 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:00:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-1c1abe10-3349-4d17-831a-24872d286980 req-3f8522a8-c80b-400c-8f24-3b15e644972c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059399 Nov 28 01:00:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 299/881] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-a5c5cfee-fc0c-4834-8a78-f01f0d14619e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" status: 200 len: 1547 microversion: 2.1 time: 0.315481 Nov 28 01:00:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 288/882] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:00:43 2023] GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c => generated 1547 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:00:45 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-14f8040a-1cf5-432e-8184-00700afa20c5 req-9591b3e2-f73b-4ebe-9aab-2a2f3de313e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c", "name": "network-vif-deleted", "tag": "403dbea6-2bda-4b17-9d20-e17ae32d6e73"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-14f8040a-1cf5-432e-8184-00700afa20c5 req-9591b3e2-f73b-4ebe-9aab-2a2f3de313e5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-14f8040a-1cf5-432e-8184-00700afa20c5 req-9591b3e2-f73b-4ebe-9aab-2a2f3de313e5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-14f8040a-1cf5-432e-8184-00700afa20c5 req-9591b3e2-f73b-4ebe-9aab-2a2f3de313e5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:45 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-14f8040a-1cf5-432e-8184-00700afa20c5 req-9591b3e2-f73b-4ebe-9aab-2a2f3de313e5 service nova] Creating event network-vif-deleted:403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c on user Nov 28 01:00:45 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-14f8040a-1cf5-432e-8184-00700afa20c5 req-9591b3e2-f73b-4ebe-9aab-2a2f3de313e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041093 Nov 28 01:00:45 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 296/883] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:00:45 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c", "name": "network-vif-plugged", "status": "completed", "tag": "403dbea6-2bda-4b17-9d20-e17ae32d6e73"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:00:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:00:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:00:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:00:45 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] Creating event network-vif-plugged:403dbea6-2bda-4b17-9d20-e17ae32d6e73 for instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c on user Nov 28 01:00:45 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-c9f6e460-ec4e-423c-afa0-810139bd1dc7 req-e36125cc-ceea-4585-b5cc-13d7ec5769c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041672 Nov 28 01:00:45 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 300/884] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:00:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:00 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-bbb8e097-d80a-496b-abd2-96931aad4a58 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 200 len: 1498 microversion: 2.1 time: 0.252867 Nov 28 01:01:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 289/885] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:01:00 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 1498 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-956573247", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "860d6281-89e3-48fc-9050-984da4b55006"}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] validate_networks() for [('860d6281-89e3-48fc-9050-984da4b55006', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Getting quotas for project eaf19f7d462f4fa2a9204479d1d35811. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:01:14 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Getting quotas for user 8679237c178f427a9cc7887c21fe12cf and project eaf19f7d462f4fa2a9204479d1d35811. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:01:15 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:01:15 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:01:15 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-35ca383d-b91f-4495-a902-2ab71434fd7f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.573600 Nov 28 01:01:15 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 297/886] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:01:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:01:15 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:15 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fe8021d0-3989-4d31-91ed-a828734a0a43 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:15 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-fe8021d0-3989-4d31-91ed-a828734a0a43 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:15 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-fe8021d0-3989-4d31-91ed-a828734a0a43 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fe8021d0-3989-4d31-91ed-a828734a0a43 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f" status: 200 len: 1208 microversion: 2.1 time: 0.076874 Nov 28 01:01:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 301/887] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:01:15 2023] GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f => generated 1208 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:15 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-27ef9212-6592-4222-a940-65034de23032 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 200 len: 1584 microversion: 2.20 time: 0.216451 Nov 28 01:01:15 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 290/888] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:01:15 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 1584 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: a5c9b82c-581e-4e29-8d34-286a293a33f9] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] HTTP exception thrown: Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 could not be found. Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Returning 404 to user: Instance a5c9b82c-581e-4e29-8d34-286a293a33f9 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:01:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-09880ea4-7542-4d87-ba31-10550b0529e3 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9" status: 404 len: 111 microversion: 2.87 time: 0.030746 Nov 28 01:01:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 298/889] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:01:16 2023] GET /compute/v2.1/servers/a5c9b82c-581e-4e29-8d34-286a293a33f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:16 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:01:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-80023446-0543-4b3c-9d91-104c110a8d6b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 204 len: 0 microversion: 2.87 time: 0.124847 Nov 28 01:01:16 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 302/890] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 01:01:16 2023] DELETE /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:16 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-5568616d-1ef5-435f-b9da-ac3be68d4ae1 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 200 len: 1775 microversion: 2.87 time: 0.307518 Nov 28 01:01:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 291/891] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:01:16 2023] GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 1775 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-unplugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] Creating event network-vif-unplugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 01:01:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-25aa61fa-75a4-415f-8da2-e09040b8cd85 req-19955942-8a42-4ea8-aaf7-31398c8f06c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033211 Nov 28 01:01:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 299/892] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:01:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:01:17 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f336a024-e3e9-4ac1-9aad-a7e1d465253f", "tag": "9d081e56-9df8-4170-90cc-83bc418127c0"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:01:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] Creating event network-changed:9d081e56-9df8-4170-90cc-83bc418127c0 for instance f336a024-e3e9-4ac1-9aad-a7e1d465253f on user Nov 28 01:01:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-9d6bb578-ba4e-41d1-929c-c752f79c907e req-fafc02f2-c9c5-40a3-9d80-cadf10472375 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028949 Nov 28 01:01:17 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 303/893] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:01:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:01:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-plugged", "status": "completed", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}, {"server_uuid": "92237bf8-8ea4-4f79-938d-6dfe03edd31d", "name": "network-vif-deleted", "tag": "d57d7084-7f1f-4e79-9770-0fe51e5f13fc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:01:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Creating event network-vif-plugged:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 01:01:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] Creating event network-vif-deleted:d57d7084-7f1f-4e79-9770-0fe51e5f13fc for instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d on user Nov 28 01:01:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-5e9d3eed-3fc1-4309-b532-447d4935c34c req-d2383f1a-f446-4029-878e-5172fad886fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035331 Nov 28 01:01:18 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 292/894] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:01:19 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f336a024-e3e9-4ac1-9aad-a7e1d465253f", "name": "network-vif-plugged", "status": "completed", "tag": "9d081e56-9df8-4170-90cc-83bc418127c0"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:01:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] Creating event network-vif-plugged:9d081e56-9df8-4170-90cc-83bc418127c0 for instance f336a024-e3e9-4ac1-9aad-a7e1d465253f on user Nov 28 01:01:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-8c2c0e33-27b3-4d00-bc83-ddf451bef9b0 req-8c6912a1-3168-47a3-b373-a062fcf76a5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034203 Nov 28 01:01:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 300/895] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:01:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:01:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f336a024-e3e9-4ac1-9aad-a7e1d465253f", "name": "network-vif-plugged", "status": "completed", "tag": "9d081e56-9df8-4170-90cc-83bc418127c0"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:01:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] Creating event network-vif-plugged:9d081e56-9df8-4170-90cc-83bc418127c0 for instance f336a024-e3e9-4ac1-9aad-a7e1d465253f on user Nov 28 01:01:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-fb75d936-4d77-4850-9b5f-1b319515c1c5 req-3297717a-a4ef-4591-98ae-d78d72b35283 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028025 Nov 28 01:01:21 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 304/896] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:01:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] [instance: 19151248-a33d-46b2-be99-0a85a5ab88d3] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] HTTP exception thrown: Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 could not be found. Nov 28 01:01:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Returning 404 to user: Instance 19151248-a33d-46b2-be99-0a85a5ab88d3 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:01:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-33517545-936d-4cf8-925f-b03906918240 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3" status: 404 len: 111 microversion: 2.1 time: 0.041058 Nov 28 01:01:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 293/897] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:01:22 2023] GET /compute/v2.1/servers/19151248-a33d-46b2-be99-0a85a5ab88d3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:01:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-809bd74e-05f3-4f9e-9407-353a7233e0f1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] Calling method '.version_select at 0x7f4972ff8670>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-809bd74e-05f3-4f9e-9407-353a7233e0f1 tempest-ServerActionsTestOtherA-277302336 tempest-ServerActionsTestOtherA-277302336-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133257069" status: 202 len: 0 microversion: 2.1 time: 0.024571 Nov 28 01:01:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 301/898] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 01:01:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133257069 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] [instance: 3702ef7a-256e-4dbe-9b8c-2980c83ddb84] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] HTTP exception thrown: Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 could not be found. Nov 28 01:01:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Returning 404 to user: Instance 3702ef7a-256e-4dbe-9b8c-2980c83ddb84 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:01:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-d16e38cf-2946-4ece-aa1b-0fb50078d568 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84" status: 404 len: 111 microversion: 2.1 time: 0.042729 Nov 28 01:01:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 305/899] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:01:24 2023] GET /compute/v2.1/servers/3702ef7a-256e-4dbe-9b8c-2980c83ddb84 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:01:28 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b60b7fcd-e5bf-4ae6-a81c-3c128aa0e1e8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] Calling method '.version_select at 0x7f4972e5a950>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b60b7fcd-e5bf-4ae6-a81c-3c128aa0e1e8 tempest-TestStampPattern-1934253251 tempest-TestStampPattern-1934253251-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1933151860" status: 202 len: 0 microversion: 2.1 time: 0.033004 Nov 28 01:01:28 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 294/900] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 01:01:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1933151860 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 could not be found. Nov 28 01:01:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:01:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2b1ec3fb-9a5b-414f-9112-72de7019609b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" status: 404 len: 111 microversion: 2.1 time: 0.054015 Nov 28 01:01:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 302/901] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:01:29 2023] GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:01:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-756c77ec-110e-4250-9a3b-a0e3429ccfd9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f" status: 204 len: 0 microversion: 2.1 time: 0.168151 Nov 28 01:01:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 306/902] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:01:33 2023] DELETE /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=16 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ee17b8-1169-4f2d-95ff-74eaf625f96f", "name": "network-vif-unplugged", "status": "completed", "tag": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:01:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:33 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:01:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] Creating event network-vif-unplugged:ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f on user Nov 28 01:01:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-22cec593-9201-4128-a8ba-95122386593a req-c91d4292-f392-4e70-87eb-60f36621d2a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030455 Nov 28 01:01:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 303/903] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:01:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:01:33 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0cc47e81-25d9-4916-a20d-f890b2012574 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f" status: 200 len: 1566 microversion: 2.1 time: 0.265426 Nov 28 01:01:33 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 295/904] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:01:33 2023] GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c could not be found. Nov 28 01:01:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:01:33 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-29bf71fe-67f2-4b56-a79d-0716dd572618 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" status: 404 len: 111 microversion: 2.1 time: 0.030121 Nov 28 01:01:33 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 307/905] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:01:33 2023] GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:01:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6779f714-4003-435b-85ac-941559afec2c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '.version_select at 0x7f4972e688b0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6779f714-4003-435b-85ac-941559afec2c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509848427" status: 202 len: 0 microversion: 2.1 time: 0.032043 Nov 28 01:01:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 304/906] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 01:01:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509848427 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:35 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'services' on Instance uuid f0b22014-115e-4871-8dfa-dd14d4c2312e {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:01:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-87f7de06-1a09-461e-9f76-53db02f08292 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-volume_attachments/89fef214-9301-4d77-bb3e-cdfa422e83de" status: 202 len: 0 microversion: 2.1 time: 0.304543 Nov 28 01:01:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 296/907] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:01:35 2023] DELETE /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-volume_attachments/89fef214-9301-4d77-bb3e-cdfa422e83de => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:01:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:01:35 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:01:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-76a76a45-fedd-45af-b3d2-b3ad67043e2f tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054332 Nov 28 01:01:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 308/908] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:01:35 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:01:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ee17b8-1169-4f2d-95ff-74eaf625f96f", "name": "network-vif-plugged", "status": "completed", "tag": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c"}, {"server_uuid": "76ee17b8-1169-4f2d-95ff-74eaf625f96f", "name": "network-vif-deleted", "tag": "ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:01:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:01:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:01:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:01:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Creating event network-vif-plugged:ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f on user Nov 28 01:01:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] Creating event network-vif-deleted:ed9c5918-85e1-49b7-b1bc-0d2dd86d6a8c for instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f on user Nov 28 01:01:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-c2744a2c-f1a4-4cd6-9138-2b5b4e193c76 req-af22eca4-bc67-4bed-92dd-6984f8d2a3c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040538 Nov 28 01:01:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 305/909] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:01:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:01 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65276) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 01:02:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d2f05e7b-4d1c-4174-960f-443fb76e8b31 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d/action" status: 202 len: 0 microversion: 2.1 time: 0.318226 Nov 28 01:02:01 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 297/910] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:02:00 2023] POST /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:01 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-eb516180-5cc1-413d-bef8-fd232f0aa559 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 200 len: 1506 microversion: 2.1 time: 0.259320 Nov 28 01:02:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 309/911] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:02:01 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:05 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-9eecb8a6-a845-467d-9d3f-0f452bf3c21f tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f" status: 200 len: 1491 microversion: 2.1 time: 0.425813 Nov 28 01:02:05 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 306/912] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:02:05 2023] GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f => generated 1491 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 92237bf8-8ea4-4f79-938d-6dfe03edd31d] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] HTTP exception thrown: Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d could not be found. Nov 28 01:02:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Returning 404 to user: Instance 92237bf8-8ea4-4f79-938d-6dfe03edd31d could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:02:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-3ced6ee6-a18d-41d0-a4d1-38d7fd01849b tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d" status: 404 len: 111 microversion: 2.87 time: 0.030308 Nov 28 01:02:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 298/913] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:02:06 2023] GET /compute/v2.1/servers/92237bf8-8ea4-4f79-938d-6dfe03edd31d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:07 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:02:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-55f389c7-f677-4bd4-8e3c-9694ba7b1912 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079" status: 204 len: 0 microversion: 2.87 time: 0.147442 Nov 28 01:02:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 310/914] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 01:02:07 2023] DELETE /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:07 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa0d095400943e28234a9f476ea0a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576886774b2943b999ec92134d8065b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:07 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1548a9e7-2b8c-4651-b759-8e4f054c8b33 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079" status: 200 len: 1695 microversion: 2.87 time: 0.312727 Nov 28 01:02:07 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 307/915] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:02:07 2023] GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079 => generated 1695 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:02:07 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-unplugged", "status": "completed", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:07 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:07 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:07 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:07 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] Creating event network-vif-unplugged:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 01:02:07 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-8f727931-d349-48d4-a9a9-be68e44b278d req-2d2c13f5-0ca0-492d-9d63-3bfd6dfec445 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028172 Nov 28 01:02:07 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 299/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-ef424a01-1f2e-49de-a589-991179b78d26 req-e77805d5-131d-4ada-816e-a62fb63b1fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-deleted", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ef424a01-1f2e-49de-a589-991179b78d26 req-e77805d5-131d-4ada-816e-a62fb63b1fee service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ef424a01-1f2e-49de-a589-991179b78d26 req-e77805d5-131d-4ada-816e-a62fb63b1fee service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ef424a01-1f2e-49de-a589-991179b78d26 req-e77805d5-131d-4ada-816e-a62fb63b1fee service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ef424a01-1f2e-49de-a589-991179b78d26 req-e77805d5-131d-4ada-816e-a62fb63b1fee service nova] Creating event network-vif-deleted:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 01:02:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-ef424a01-1f2e-49de-a589-991179b78d26 req-e77805d5-131d-4ada-816e-a62fb63b1fee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041547 Nov 28 01:02:08 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 311/917] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:09 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-plugged", "status": "completed", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}, {"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-plugged", "status": "completed", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}, {"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-plugged", "status": "completed", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}, {"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-unplugged", "status": "completed", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}, {"server_uuid": "55113bea-793b-4d9f-a897-f6f7eb261079", "name": "network-vif-plugged", "status": "completed", "tag": "178ea9e9-90f7-4fce-a4eb-a1d90ad483ed"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Creating event network-vif-plugged:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 01:02:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Creating event network-vif-plugged:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 01:02:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Creating event network-vif-plugged:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 01:02:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Creating event network-vif-unplugged:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 01:02:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] Creating event network-vif-plugged:178ea9e9-90f7-4fce-a4eb-a1d90ad483ed for instance 55113bea-793b-4d9f-a897-f6f7eb261079 on user Nov 28 01:02:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-e2d9787e-cd85-4f6c-8095-e609d062c0e7 req-ddd28d5e-648d-43ea-8011-bf5b655eea49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.047196 Nov 28 01:02:09 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 308/918] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:09 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] Creating event network-changed:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:02:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ee95b09a-5f3f-40e9-b5f2-885d1d267938 req-123616f7-d0e2-4d3c-a0bc-f7d90ff61de9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029814 Nov 28 01:02:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 300/919] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:13 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-plugged", "status": "completed", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:13 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] Creating event network-vif-plugged:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:02:13 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-bc3821d3-c8dc-41ba-95f4-b88e753a2112 req-a7b4b077-4b4f-4bf5-bd14-3549c82ad928 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035667 Nov 28 01:02:13 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 312/920] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:15 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:15 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:15 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:15 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7a400126-af03-44b8-8312-053a4091383c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.142574 Nov 28 01:02:15 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 309/921] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 01:02:15 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/os-interface => generated 282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:02:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-plugged", "status": "completed", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:15 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] Creating event network-vif-plugged:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:02:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-1c6373ab-4806-4bcc-8e35-6eacbc0d682f req-8162e659-c72b-42df-8a46-6d95cff5dd4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031025 Nov 28 01:02:15 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 301/922] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:16 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:17 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a0f30a22-8725-421b-b534-27e363bcb5a2 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/ips" status: 200 len: 110 microversion: 2.20 time: 0.045163 Nov 28 01:02:17 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 313/923] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 28 01:02:16 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/ips => generated 110 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:02:17 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] Creating event network-changed:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:02:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-951c47ea-5f87-4141-80e3-e572a8361102 req-ce8fe151-2b80-416b-9ab5-eb492ee93efb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118944 Nov 28 01:02:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 310/924] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:19 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lazy-loading 'flavor' on Instance uuid 15050b6f-4cc9-45e8-81f0-56ef01c3f703 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:02:21 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e65fb76d-59a4-4e8a-9552-d176410fe3d3 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/action" status: 202 len: 0 microversion: 2.20 time: 1.474616 Nov 28 01:02:21 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 302/925] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 01:02:19 2023] POST /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/action => generated 0 bytes in 1476 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:21 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e0ef753d-b65b-4ad6-9502-0fe2046e708f tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 200 len: 1709 microversion: 2.20 time: 0.265706 Nov 28 01:02:21 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 314/926] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:02:21 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 1709 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:02:21 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-unplugged", "status": "completed", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] Creating event network-vif-unplugged:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:02:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-f04f6e25-ef29-480d-acdd-ce69cef2dd66 req-741d2a29-f02c-46ec-ba45-7f1c459eedc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209329 Nov 28 01:02:21 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 311/927] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:23 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f could not be found. Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:02:23 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2fc7db2d-2b60-4d44-be80-2c4711e4e052 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f" status: 404 len: 111 microversion: 2.1 time: 0.034610 Nov 28 01:02:23 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 303/928] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:02:23 2023] GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:02:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-plugged", "status": "completed", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] Creating event network-vif-plugged:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-95a1e440-d04c-49a3-8cbb-9691d455eba9 req-9ea30268-148f-4232-91e2-90a3326346fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038105 Nov 28 01:02:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 315/929] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 could not be found. Nov 28 01:02:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:02:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-809e4076-8c25-42ca-83ef-4bb0b0fce69b tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" status: 404 len: 111 microversion: 2.1 time: 0.031413 Nov 28 01:02:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 312/930] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:02:23 2023] DELETE /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:23 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 could not be found. Nov 28 01:02:23 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:02:23 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-881d356d-f6f9-4024-9326-c801428f35c3 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20" status: 404 len: 111 microversion: 2.1 time: 0.031510 Nov 28 01:02:23 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 304/931] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:02:23 2023] GET /compute/v2.1/servers/60c7bb1b-c43a-439b-8bcd-2e3dbd2e3a20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:02:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6564c366-3151-4ab4-97b4-080124c89fe2 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '.version_select at 0x7f49731c8a60>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6564c366-3151-4ab4-97b4-080124c89fe2 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755313768" status: 202 len: 0 microversion: 2.1 time: 0.040379 Nov 28 01:02:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 316/932] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 01:02:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755313768 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f could not be found. Nov 28 01:02:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:02:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e5be17a8-e809-4d4a-9cf6-342fe064f419 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f" status: 404 len: 111 microversion: 2.1 time: 0.028901 Nov 28 01:02:24 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 313/933] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:02:24 2023] DELETE /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: 76ee17b8-1169-4f2d-95ff-74eaf625f96f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f could not be found. Nov 28 01:02:24 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance 76ee17b8-1169-4f2d-95ff-74eaf625f96f could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:02:24 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b97807c9-b5fd-41a8-a9c9-3f1ad9aa1cda tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f" status: 404 len: 111 microversion: 2.1 time: 0.027236 Nov 28 01:02:24 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 305/934] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:02:24 2023] GET /compute/v2.1/servers/76ee17b8-1169-4f2d-95ff-74eaf625f96f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 01:02:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a9f5ed10-8b8b-40bc-b467-f282a68c6c02 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '.version_select at 0x7f4972fd1750>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a9f5ed10-8b8b-40bc-b467-f282a68c6c02 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1686178802" status: 202 len: 0 microversion: 2.1 time: 0.021335 Nov 28 01:02:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 317/935] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 01:02:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1686178802 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-9b3319ac-c1c5-4908-ba48-e402c309cf68 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: .version_select at 0x7f4972f963b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-832294225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5MU7a1/g/o09J6nLap0JvGvwCkHZwbfUK7MHanQhcRvkt22RuSIn2wJK3bw4jkl+K62gg9CRV1cfoWdlhzIi25Wx8s7FFtM/1jPlW3mlSUP0i+6CA1s34Gdb35md+t6A=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-9b3319ac-c1c5-4908-ba48-e402c309cf68 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-9b3319ac-c1c5-4908-ba48-e402c309cf68 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:02:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-9b3319ac-c1c5-4908-ba48-e402c309cf68 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.072373 Nov 28 01:02:25 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 314/936] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:02:25 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:25 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-efbdaf47-d5b4-4c64-b60b-20b1e855fd85 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055797 Nov 28 01:02:25 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 306/937] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:02:25 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:25 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:02:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5096d1f1-6f37-4199-b476-fe99761fc3ed tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e" status: 204 len: 0 microversion: 2.1 time: 0.166013 Nov 28 01:02:25 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 318/938] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:02:25 2023] DELETE /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:26 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:26 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c50691d8-e942-42ec-bf79-b6eef81c43ad tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e" status: 200 len: 1665 microversion: 2.1 time: 0.537205 Nov 28 01:02:26 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 315/939] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:02:25 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e => generated 1665 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:02:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b22014-115e-4871-8dfa-dd14d4c2312e", "name": "network-vif-unplugged", "status": "completed", "tag": "265df925-6615-406d-8c78-0de24d0d6812"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] Creating event network-vif-unplugged:265df925-6615-406d-8c78-0de24d0d6812 for instance f0b22014-115e-4871-8dfa-dd14d4c2312e on user Nov 28 01:02:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-538c1654-2a43-4096-b067-9dd8ca083c21 req-582f89c2-cc11-471c-b7a3-50a38a35ff71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041467 Nov 28 01:02:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 307/940] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:02:27 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:27 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] Creating event network-changed:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:02:27 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-e636e3db-f5b7-4607-b893-33d0c4d16aeb req-d97be530-93ff-4a57-864a-3163a6826d5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059441 Nov 28 01:02:27 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 319/941] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b22014-115e-4871-8dfa-dd14d4c2312e", "name": "network-vif-deleted", "tag": "265df925-6615-406d-8c78-0de24d0d6812"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] Creating event network-vif-deleted:265df925-6615-406d-8c78-0de24d0d6812 for instance f0b22014-115e-4871-8dfa-dd14d4c2312e on user Nov 28 01:02:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-dee26a84-58bc-4995-885d-56670a4c1578 req-684c4989-fad4-4920-a833-f485c3a63ead service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039989 Nov 28 01:02:27 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 316/942] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:28 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0b22014-115e-4871-8dfa-dd14d4c2312e", "name": "network-vif-plugged", "status": "completed", "tag": "265df925-6615-406d-8c78-0de24d0d6812"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] Creating event network-vif-plugged:265df925-6615-406d-8c78-0de24d0d6812 for instance f0b22014-115e-4871-8dfa-dd14d4c2312e on user Nov 28 01:02:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ad555cb7-5b32-4be6-8283-79f923f177b9 req-89bfa634-edce-4f86-bb8e-ab2b248088c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050654 Nov 28 01:02:28 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 308/943] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:33 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-172133659", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-27195325"}], "block_device_mapping_v2": [{"uuid": "570e5115-038a-4d98-a168-791774596b4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-832294225", "networks": [{"uuid": "e7a9c673-be29-4f27-b00a-34793dbf68b7"}]}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:33 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] validate_networks() for [('e7a9c673-be29-4f27-b00a-34793dbf68b7', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:02:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='570e5115-038a-4d98-a168-791774596b4e',volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:02:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e708776e-5a97-433d-b430-782e2750b0c1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.896818 Nov 28 01:02:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 320/944] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:02:33 2023] POST /compute/v2.1/servers => generated 402 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:02:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1c56d195-98a7-4760-82c0-ad6916211016 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:34 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1c56d195-98a7-4760-82c0-ad6916211016 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:34 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-1c56d195-98a7-4760-82c0-ad6916211016 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1c56d195-98a7-4760-82c0-ad6916211016 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597" status: 200 len: 1086 microversion: 2.1 time: 0.076914 Nov 28 01:02:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 317/945] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:02:34 2023] GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597 => generated 1086 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:02:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be77ede0-959e-461b-b138-20828368b597", "tag": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] Creating event network-changed:56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance be77ede0-959e-461b-b138-20828368b597 on user Nov 28 01:02:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-29f121be-0b00-46b2-8fe5-8f153a166085 req-bcf40b7d-9f41-4c47-97ae-70d97ae83d4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194964 Nov 28 01:02:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 309/946] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:45 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:45 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:45 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:45 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:45 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be77ede0-959e-461b-b138-20828368b597", "name": "network-vif-plugged", "status": "completed", "tag": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:45 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] Creating event network-vif-plugged:56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance be77ede0-959e-461b-b138-20828368b597 on user Nov 28 01:02:45 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-e46e58d6-21cb-4bec-89e2-e3c79968655f req-bd2b4cd4-2a0d-43e6-9880-259230885dc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061313 Nov 28 01:02:45 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 321/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:02:47 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be77ede0-959e-461b-b138-20828368b597", "name": "network-vif-plugged", "status": "completed", "tag": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:02:47 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=34 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:47 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:47 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] Creating event network-vif-plugged:56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance be77ede0-959e-461b-b138-20828368b597 on user Nov 28 01:02:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-86664e7d-3fa1-4e27-91e9-743908e1534d req-aa334cb8-2694-475e-9b5c-4b0a0669142e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061014 Nov 28 01:02:47 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 318/948] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:02:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:51 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:02:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-1b08f93c-2232-410c-bf5a-6df855db21ed tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 200 len: 1551 microversion: 2.1 time: 0.280213 Nov 28 01:02:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 310/949] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:02:51 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 1551 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] [instance: 55113bea-793b-4d9f-a897-f6f7eb261079] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:02:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] HTTP exception thrown: Instance 55113bea-793b-4d9f-a897-f6f7eb261079 could not be found. Nov 28 01:02:57 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] Returning 404 to user: Instance 55113bea-793b-4d9f-a897-f6f7eb261079 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:02:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c2974f44-1bdf-4ea1-b82e-9d434535a048 tempest-ServerBootFromVolumeStableRescueTest-1091313688 tempest-ServerBootFromVolumeStableRescueTest-1091313688-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079" status: 404 len: 111 microversion: 2.87 time: 0.032537 Nov 28 01:02:57 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 322/950] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:02:57 2023] GET /compute/v2.1/servers/55113bea-793b-4d9f-a897-f6f7eb261079 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:05 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:03:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-293fd373-5c00-4e9e-9e66-e8cb16bf94cf tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f" status: 204 len: 0 microversion: 2.1 time: 0.152765 Nov 28 01:03:05 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 319/951] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:03:05 2023] DELETE /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:06 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9e8cb616-a941-4333-9cba-1c65981173cd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f" status: 200 len: 1497 microversion: 2.1 time: 0.616837 Nov 28 01:03:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 311/952] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:03:05 2023] GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f => generated 1497 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:03:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f336a024-e3e9-4ac1-9aad-a7e1d465253f", "name": "network-vif-deleted", "tag": "9d081e56-9df8-4170-90cc-83bc418127c0"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] Creating event network-vif-deleted:9d081e56-9df8-4170-90cc-83bc418127c0 for instance f336a024-e3e9-4ac1-9aad-a7e1d465253f on user Nov 28 01:03:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-d13e9766-0f53-4057-86c2-9c1c779c7fd6 req-7e09bcfd-dda9-48da-8c64-7e5fdca48d1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035799 Nov 28 01:03:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 323/953] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:08 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-99dc6484-5954-463a-9321-27b2d8878001 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Action: 'create', calling method: .version_select at 0x7f4972f95120>, body: {"keypair": {"name": "tempest-keypair-1738700815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcFw9WNsB/WfF2yeONFBuXL4tVJCd6mCroGfOuvO/4DxlzDl5xxqNI0VkgQOtsTie1dnmO3kC91WgA34H9SFtyuAC+3yOr2ehde8YyilFwrcwTfGsSkIzwL3ui6imEtuQ=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:08 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-99dc6484-5954-463a-9321-27b2d8878001 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Getting quotas for project dc686f7daecb4843b4b0b4f1e89dec89. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:03:08 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-99dc6484-5954-463a-9321-27b2d8878001 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Getting quotas for user e48c3f1b52e54c41b4499cbc2b767419 and project dc686f7daecb4843b4b0b4f1e89dec89. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:03:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-99dc6484-5954-463a-9321-27b2d8878001 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058869 Nov 28 01:03:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 320/954] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:03:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-630894117", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "5e981df9-133f-43c2-bf2e-06e00574b620"}], "security_groups": [{"name": "tempest-securitygroup--803682684"}], "key_name": "tempest-keypair-1738700815", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] validate_networks() for [('5e981df9-133f-43c2-bf2e-06e00574b620', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Getting quotas for project dc686f7daecb4843b4b0b4f1e89dec89. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Getting quotas for user e48c3f1b52e54c41b4499cbc2b767419 and project dc686f7daecb4843b4b0b4f1e89dec89. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:03:09 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:03:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-ff9fd5ab-7e0a-401b-a8ff-785da36a16c9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.518429 Nov 28 01:03:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 312/955] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:03:09 2023] POST /compute/v2.1/servers => generated 403 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:03:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1fdafee9-379e-42bc-b1b6-b1ce6894ffd5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-1fdafee9-379e-42bc-b1b6-b1ce6894ffd5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:10 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-1fdafee9-379e-42bc-b1b6-b1ce6894ffd5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c3f1b52e54c41b4499cbc2b767419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc686f7daecb4843b4b0b4f1e89dec89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-1fdafee9-379e-42bc-b1b6-b1ce6894ffd5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 200 len: 1237 microversion: 2.1 time: 0.213113 Nov 28 01:03:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 324/956] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:03:10 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:11 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:11 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0ac3fb6f-1511-41d3-869b-f656d6413900 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 200 len: 1650 microversion: 2.20 time: 0.205167 Nov 28 01:03:11 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 321/957] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:03:11 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 1650 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 01:03:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] Creating event network-changed:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:03:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-2b6d392e-1215-4dd2-a30e-51e3fa6b97e0 req-9ec3a8be-2fb7-42ff-9b1c-f839bba94ea6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030238 Nov 28 01:03:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 313/958] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:03:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-48bd7c42-bf15-4a3f-903a-80745143e852 req-d44277fc-9f9d-4c84-b66a-80debfbcac74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040971 Nov 28 01:03:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 325/959] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:03:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance f0b22014-115e-4871-8dfa-dd14d4c2312e could not be found. Nov 28 01:03:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance f0b22014-115e-4871-8dfa-dd14d4c2312e could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:03:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-fea362d5-b724-485a-9439-603b938edda1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e" status: 404 len: 111 microversion: 2.1 time: 0.029379 Nov 28 01:03:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 314/960] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:03:16 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:03:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5034f582-e44d-4c4b-9f33-80c5203d825b req-aa37e2a4-97f0-4349-9a37-208da1a42d4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081091 Nov 28 01:03:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-def9b7c0-8b69-4f07-bf06-4d35002822e1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '.version_select at 0x7f49731ca830>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 322/961] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:03:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-def9b7c0-8b69-4f07-bf06-4d35002822e1 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-252894268" status: 202 len: 0 microversion: 2.1 time: 0.023204 Nov 28 01:03:16 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 326/962] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 01:03:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-252894268 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:03:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d2054333-98bd-4e8c-a28c-ba8f1bc5b7cc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: .version_select at 0x7f4972ee30a0>, body: {"keypair": {"name": "tempest-keypair-1774369941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVwyioFYYrzy8F+NUX5Ky5kFXporVF3GEo/6CywbWGUbIrn89eveMlhxaNDiTAuA4nTc6D7rl47f1VM0u2KrFNTDEZxG2jtNvGvJ9opo8Kgq4UkoMxsZsWx3u3NVjKHyA=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:17 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-d2054333-98bd-4e8c-a28c-ba8f1bc5b7cc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:03:17 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-d2054333-98bd-4e8c-a28c-ba8f1bc5b7cc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for user 6692115b7e8042c38fb8ecb84a5af250 and project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:03:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d2054333-98bd-4e8c-a28c-ba8f1bc5b7cc tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051709 Nov 28 01:03:17 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 315/963] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:03:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:18 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1303619575", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "17b52fdf-8b78-4226-b39e-12aa8c2e462a"}], "security_groups": [{"name": "tempest-securitygroup--1561771058"}], "key_name": "tempest-keypair-1774369941", "user_data": "}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:18 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] validate_networks() for [('17b52fdf-8b78-4226-b39e-12aa8c2e462a', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for user 6692115b7e8042c38fb8ecb84a5af250 and project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:03:19 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:03:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-8edd9ece-2711-4fad-9df1-ac38a06fdee8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.929985 Nov 28 01:03:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 323/964] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:03:18 2023] POST /compute/v2.1/servers => generated 400 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:03:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-80068008-80b2-4108-96b7-1422271fba93 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:19 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-80068008-80b2-4108-96b7-1422271fba93 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:19 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-80068008-80b2-4108-96b7-1422271fba93 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-80068008-80b2-4108-96b7-1422271fba93 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc" status: 200 len: 1234 microversion: 2.1 time: 0.065244 Nov 28 01:03:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 327/965] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:03:19 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc => generated 1234 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:03:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4968288-fce2-45df-8ec1-9fc8b7db41cc", "tag": "c54006a4-4d8f-444d-897a-419008313a91"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] Creating event network-changed:c54006a4-4d8f-444d-897a-419008313a91 for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc on user Nov 28 01:03:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-bf8b0a3c-ef98-4c8a-995f-b32b29924e39 req-801784cc-cd43-41c1-89c4-9452912e72ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053372 Nov 28 01:03:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 316/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4968288-fce2-45df-8ec1-9fc8b7db41cc", "name": "network-vif-plugged", "status": "completed", "tag": "c54006a4-4d8f-444d-897a-419008313a91"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] Creating event network-vif-plugged:c54006a4-4d8f-444d-897a-419008313a91 for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc on user Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-6a49769f-c998-4fbb-bdc5-f09dc6384a77 req-29a6ba5b-97ee-4f2b-a9e2-2366c55306fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046513 Nov 28 01:03:24 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 324/967] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:24 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-adf87f8f-71d1-4863-a38c-a71d50e34661 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597" status: 200 len: 1437 microversion: 2.1 time: 0.336708 Nov 28 01:03:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 328/968] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:03:24 2023] GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597 => generated 1437 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:03:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4968288-fce2-45df-8ec1-9fc8b7db41cc", "name": "network-vif-plugged", "status": "completed", "tag": "c54006a4-4d8f-444d-897a-419008313a91"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] Creating event network-vif-plugged:c54006a4-4d8f-444d-897a-419008313a91 for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc on user Nov 28 01:03:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-b6654943-a61e-4fb2-8359-1280d1f5b749 req-086fcc7c-e2ef-4c33-a682-ee6a88d3291c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029264 Nov 28 01:03:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 317/969] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:52 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] Creating event network-changed:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:03:52 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4e10a727-9a48-4600-aa8b-4c3da200f754 req-bae19856-ddf1-423c-b23e-5fb1e125c7aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034453 Nov 28 01:03:52 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 329/970] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:52 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:03:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-a875d865-117a-45b9-940e-dba395efff97 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 204 len: 0 microversion: 2.1 time: 0.125796 Nov 28 01:03:52 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 325/971] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:03:52 2023] DELETE /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:03:52 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=10 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:52 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=16 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-unplugged", "status": "completed", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] Creating event network-vif-unplugged:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:03:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-b5faf05f-a34e-43a8-a031-d16521bb21b3 req-0286acdd-8ff1-49d7-9b5e-91cabea5ab89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095716 Nov 28 01:03:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 330/972] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:53 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbce18d8a1ce4e25a7ba0043f40a3a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42084ccfd4f3455f976a532e4dbf19f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-002333cb-4fb9-4c9e-bb39-a954db0a454d tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 200 len: 1557 microversion: 2.1 time: 0.415037 Nov 28 01:03:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 318/973] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:03:52 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 1557 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:03:54 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0e4c5677-f6ca-4650-bbd9-ac207c80e4d4 req-4ecddf8b-e3eb-47a4-95b2-b37c1dd9ab69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-deleted", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0e4c5677-f6ca-4650-bbd9-ac207c80e4d4 req-4ecddf8b-e3eb-47a4-95b2-b37c1dd9ab69 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0e4c5677-f6ca-4650-bbd9-ac207c80e4d4 req-4ecddf8b-e3eb-47a4-95b2-b37c1dd9ab69 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:54 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0e4c5677-f6ca-4650-bbd9-ac207c80e4d4 req-4ecddf8b-e3eb-47a4-95b2-b37c1dd9ab69 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:54 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0e4c5677-f6ca-4650-bbd9-ac207c80e4d4 req-4ecddf8b-e3eb-47a4-95b2-b37c1dd9ab69 service nova] Creating event network-vif-deleted:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:03:54 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0e4c5677-f6ca-4650-bbd9-ac207c80e4d4 req-4ecddf8b-e3eb-47a4-95b2-b37c1dd9ab69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050856 Nov 28 01:03:54 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 326/974] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:55 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e61e82c-a198-4f76-a2b8-84b3c58be36d", "name": "network-vif-plugged", "status": "completed", "tag": "64a1cff7-65f8-4910-82eb-3e8332324c63"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:03:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] Creating event network-vif-plugged:64a1cff7-65f8-4910-82eb-3e8332324c63 for instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d on user Nov 28 01:03:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-57679cac-2354-42a7-a163-c570fb9efc1a req-09177179-7319-4552-893f-0a0a28f170d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027365 Nov 28 01:03:55 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 331/975] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:03:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] HTTP exception thrown: Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f could not be found. Nov 28 01:03:56 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Returning 404 to user: Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:03:56 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-babc35f1-b703-420e-83d5-f603a8cad0c0 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f" status: 404 len: 111 microversion: 2.1 time: 0.025530 Nov 28 01:03:56 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 319/976] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:03:56 2023] GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:03:56 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:03:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0f1cbc80-ef31-44ff-9532-e3ca44ebff58 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 200 len: 1491 microversion: 2.1 time: 0.221731 Nov 28 01:03:56 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 327/977] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:03:56 2023] GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 1491 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:00 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c3f1b52e54c41b4499cbc2b767419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc686f7daecb4843b4b0b4f1e89dec89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:04:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-1a59cc1e-ab97-4e70-8b03-7ff64f3d98e0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 200 len: 1549 microversion: 2.1 time: 0.261007 Nov 28 01:04:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 332/978] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:04:00 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 1549 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:09 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:04:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-73d436ec-3109-4dc0-8700-7b97aaf999e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc" status: 200 len: 1544 microversion: 2.1 time: 0.187765 Nov 28 01:04:09 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 320/979] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:04:09 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc => generated 1544 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:04:11 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:11 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:11 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "578805c8-6dd0-4108-9fa5-e6183c1c69dc"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:11 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-f0d1ab55-de01-43d2-b122-f372fd2fca4d tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.522414 Nov 28 01:04:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 328/980] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 01:04:11 2023] POST /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/os-volume_attachments => generated 188 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=12 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:12 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-2b6ab1dc-97a0-4e00-8ed4-6e37d36d1d01 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/os-volume_attachments/578805c8-6dd0-4108-9fa5-e6183c1c69dc" status: 202 len: 0 microversion: 2.20 time: 0.296239 Nov 28 01:04:12 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 333/981] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 01:04:12 2023] DELETE /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/os-volume_attachments/578805c8-6dd0-4108-9fa5-e6183c1c69dc => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:12 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65276) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 01:04:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-978691c1-fd44-4aec-b2bd-4d80df6c66ce tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/action" status: 202 len: 0 microversion: 2.20 time: 0.100690 Nov 28 01:04:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 321/982] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 01:04:12 2023] POST /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:13 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:04:13 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:04:13 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:04:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-daf31442-6a90-48ea-a8cc-fe9e9a540174 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 200 len: 1658 microversion: 2.20 time: 0.211165 Nov 28 01:04:13 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 329/983] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:04:12 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 1658 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:04:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] Creating event network-changed:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:04:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-b95312fe-998f-4034-b3c9-961b766bbdda req-9845446c-95c3-46b3-ac93-e93cf60b474e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028156 Nov 28 01:04:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 334/984] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:04:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:04:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-plugged", "status": "completed", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] Creating event network-vif-plugged:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:04:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-6257c90f-a914-40c9-bce7-42488c909578 req-25c0262d-6177-49f7-a131-9163d259a61e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057689 Nov 28 01:04:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 322/985] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:04:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:04:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-plugged", "status": "completed", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:24 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:24 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] Creating event network-vif-plugged:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:04:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-431d6db9-3cea-431e-a8a7-5e0af83324db req-4b481f4b-84df-437b-ae52-81dd7027df44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056893 Nov 28 01:04:24 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 330/986] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:04:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:04:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:24 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:25 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:04:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-9beafa50-086f-4cd5-9313-7c12223ecbcf tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597" status: 200 len: 1437 microversion: 2.1 time: 0.398065 Nov 28 01:04:25 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 335/987] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:04:24 2023] GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597 => generated 1437 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:04:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be77ede0-959e-461b-b138-20828368b597", "tag": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] Creating event network-changed:56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance be77ede0-959e-461b-b138-20828368b597 on user Nov 28 01:04:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-226e9ab8-ec19-4ee8-bf78-eb642ae68fbc req-d5c5766e-fac0-4d41-8c69-adaf1b1ab540 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031217 Nov 28 01:04:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 323/988] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:04:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:27 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:04:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-18a7c37d-25f7-43e1-b234-1e765a0878e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597" status: 204 len: 0 microversion: 2.1 time: 0.114158 Nov 28 01:04:27 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 331/989] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:04:27 2023] DELETE /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:27 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:04:27 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-1526c271-896b-49a6-84a8-35c894be6a38 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597" status: 200 len: 1561 microversion: 2.1 time: 0.201179 Nov 28 01:04:27 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 336/990] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:04:27 2023] GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597 => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 01:04:28 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be77ede0-959e-461b-b138-20828368b597", "name": "network-vif-unplugged", "status": "completed", "tag": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714"}, {"server_uuid": "be77ede0-959e-461b-b138-20828368b597", "name": "network-vif-plugged", "status": "completed", "tag": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Creating event network-vif-unplugged:56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance be77ede0-959e-461b-b138-20828368b597 on user Nov 28 01:04:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] Creating event network-vif-plugged:56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance be77ede0-959e-461b-b138-20828368b597 on user Nov 28 01:04:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-97978476-a04d-450c-90a0-88c7986d51f5 req-12098969-4043-4beb-8b0f-c4093940f86f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.060664 Nov 28 01:04:28 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 324/991] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:04:28 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:04:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-4b70952c-c13e-4c14-a51f-8655e7aac45e req-09c5617a-90d7-49dd-8dc6-a33f41bba198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be77ede0-959e-461b-b138-20828368b597", "name": "network-vif-deleted", "tag": "56d5d18b-88c0-4129-9c0f-5fdf04fa7714"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4b70952c-c13e-4c14-a51f-8655e7aac45e req-09c5617a-90d7-49dd-8dc6-a33f41bba198 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4b70952c-c13e-4c14-a51f-8655e7aac45e req-09c5617a-90d7-49dd-8dc6-a33f41bba198 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-4b70952c-c13e-4c14-a51f-8655e7aac45e req-09c5617a-90d7-49dd-8dc6-a33f41bba198 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-4b70952c-c13e-4c14-a51f-8655e7aac45e req-09c5617a-90d7-49dd-8dc6-a33f41bba198 service nova] Creating event network-vif-deleted:56d5d18b-88c0-4129-9c0f-5fdf04fa7714 for instance be77ede0-959e-461b-b138-20828368b597 on user Nov 28 01:04:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-4b70952c-c13e-4c14-a51f-8655e7aac45e req-09c5617a-90d7-49dd-8dc6-a33f41bba198 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030352 Nov 28 01:04:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 332/992] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:04:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] [instance: 1e61e82c-a198-4f76-a2b8-84b3c58be36d] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] HTTP exception thrown: Instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d could not be found. Nov 28 01:04:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Returning 404 to user: Instance 1e61e82c-a198-4f76-a2b8-84b3c58be36d could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:04:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-8c0be94c-5ed2-41d5-a6fa-da73142ea681 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d" status: 404 len: 111 microversion: 2.1 time: 0.036670 Nov 28 01:04:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 337/993] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:04:43 2023] GET /compute/v2.1/servers/1e61e82c-a198-4f76-a2b8-84b3c58be36d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:04:43 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:43 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:43 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7e3261fb-58c1-42d0-9ed4-0009d99b21d9 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] Calling method '.version_select at 0x7f4972d80700>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-7e3261fb-58c1-42d0-9ed4-0009d99b21d9 tempest-TestShelveInstance-715884180 tempest-TestShelveInstance-715884180-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2097820211" status: 202 len: 0 microversion: 2.1 time: 0.028719 Nov 28 01:04:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 325/994] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 28 01:04:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2097820211 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:04:59 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:59 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:59 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1899c8fb-6fe8-4f8c-8d8b-c71cfefc37e8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2100603793", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b6711f8e-45dc-476a-9f54-a4cd5dfdd791", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "860d6281-89e3-48fc-9050-984da4b55006"}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:04:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-1899c8fb-6fe8-4f8c-8d8b-c71cfefc37e8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] HTTP exception thrown: Block Device b6711f8e-45dc-476a-9f54-a4cd5dfdd791 is not bootable. Nov 28 01:04:59 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1899c8fb-6fe8-4f8c-8d8b-c71cfefc37e8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Returning 400 to user: Block Device b6711f8e-45dc-476a-9f54-a4cd5dfdd791 is not bootable. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:04:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1899c8fb-6fe8-4f8c-8d8b-c71cfefc37e8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.077464 Nov 28 01:04:59 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 333/995] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:04:59 2023] POST /compute/v2.1/servers => generated 110 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:04:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:00 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:05:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-3c3a463d-d977-4919-8e14-e73e2837749e tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 200 len: 1491 microversion: 2.1 time: 0.214770 Nov 28 01:05:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 338/996] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:04:59 2023] GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 1491 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b092c3da-4d64-482d-a783-b2619fcb71b7 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.137252 Nov 28 01:05:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 326/997] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:05:00 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-interface => generated 282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] Creating event network-changed:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:05:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-68738285-2199-4238-aba1-2b399374aaf0 req-30219912-eca2-476f-8b85-b60220863141 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045889 Nov 28 01:05:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 334/998] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-488670358"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:02 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6d7c370d-3c99-4af5-aaad-3da92423be00 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/action" status: 202 len: 0 microversion: 2.1 time: 0.926983 Nov 28 01:05:02 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 339/999] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:05:01 2023] POST /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/action => generated 0 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 01:05:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-3194d979-2f8d-44ad-9b52-f8637bb001e4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '.version_select at 0x7f4972d80820>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-3194d979-2f8d-44ad-9b52-f8637bb001e4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/images/a5699749-679c-437d-ba53-0bd7dd814a0e" status: 200 len: 1608 microversion: 2.1 time: 0.052967 Nov 28 01:05:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 327/1000] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 01:05:02 2023] GET /compute/v2.1/images/a5699749-679c-437d-ba53-0bd7dd814a0e => generated 1608 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:05:03 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:05:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7e157f55-9c2d-4681-8c56-3085ffb70670 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 200 len: 1703 microversion: 2.20 time: 0.237013 Nov 28 01:05:03 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 335/1001] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:05:03 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 1703 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:05:09 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:09 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:09 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-664f8b6f-cba1-4110-b569-da65c949b134 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.137970 Nov 28 01:05:09 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 340/1002] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:05:09 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-interface => generated 283 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4968288-fce2-45df-8ec1-9fc8b7db41cc", "tag": "c54006a4-4d8f-444d-897a-419008313a91"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] Creating event network-changed:c54006a4-4d8f-444d-897a-419008313a91 for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc on user Nov 28 01:05:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-93cf4fd2-9af3-4b14-9ee5-ae5f9c3ee939 req-8a25c146-fb8e-4519-abb3-972f9d40b060 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031819 Nov 28 01:05:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 328/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:05:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:10 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0f60e570-927e-4fee-a216-ceb90231c099 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/ips" status: 200 len: 108 microversion: 2.1 time: 0.079129 Nov 28 01:05:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 336/1004] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 01:05:10 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/ips => generated 108 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:13 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0dad8bc-bbd0-44e7-a817-7b1267b10aa2"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:13 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:13 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f06b822d-1254-446e-aa43-cbec0d8fc792 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274355 Nov 28 01:05:13 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 341/1005] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:05:13 2023] POST /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance be77ede0-959e-461b-b138-20828368b597 could not be found. Nov 28 01:05:17 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance be77ede0-959e-461b-b138-20828368b597 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:05:17 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-04072eca-59a7-45f6-88ce-68c0e533d2e9 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597" status: 404 len: 111 microversion: 2.1 time: 0.034205 Nov 28 01:05:17 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 329/1006] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:05:17 2023] GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:05:17 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-721476830", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-27195325"}], "block_device_mapping_v2": [{"uuid": "570e5115-038a-4d98-a168-791774596b4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-832294225", "networks": [{"uuid": "e7a9c673-be29-4f27-b00a-34793dbf68b7"}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:17 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] validate_networks() for [('e7a9c673-be29-4f27-b00a-34793dbf68b7', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:05:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='570e5115-038a-4d98-a168-791774596b4e',volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:05:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-f9cccedd-d3d1-4d9b-b5ab-ce40b40d815d tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.788018 Nov 28 01:05:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 337/1007] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:05:17 2023] POST /compute/v2.1/servers => generated 402 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:05:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3ab0ae33-20b5-4f85-a125-4e324e6abd78 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:18 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-3ab0ae33-20b5-4f85-a125-4e324e6abd78 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:18 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-3ab0ae33-20b5-4f85-a125-4e324e6abd78 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:05:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-3ab0ae33-20b5-4f85-a125-4e324e6abd78 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada" status: 200 len: 1086 microversion: 2.1 time: 0.073265 Nov 28 01:05:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 342/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:05:18 2023] GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada => generated 1086 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:05:20 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9ab357-37c6-410c-919c-a144d4261ada", "tag": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] Creating event network-changed:c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance be9ab357-37c6-410c-919c-a144d4261ada on user Nov 28 01:05:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-931b2256-679d-4327-b725-b2315c49f693 req-aa5ba4f9-9ef2-49c6-bf7d-d18568e33db1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059916 Nov 28 01:05:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 330/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0dad8bc-bbd0-44e7-a817-7b1267b10aa2"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Invalid volume: volume f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 is already attached to instances: a4968288-fce2-45df-8ec1-9fc8b7db41cc Nov 28 01:05:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 400 to user: Invalid volume: volume f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 is already attached to instances: a4968288-fce2-45df-8ec1-9fc8b7db41cc {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:05:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-4fedb587-fbfb-42ce-ad1a-e9d913502b84 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098907 Nov 28 01:05:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 338/1010] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:05:23 2023] POST /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:23 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'services' on Instance uuid a4968288-fce2-45df-8ec1-9fc8b7db41cc {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:05:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-44e2e4d3-1d21-46e0-aaa1-26b3faab593a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments/f0dad8bc-bbd0-44e7-a817-7b1267b10aa2" status: 202 len: 0 microversion: 2.1 time: 0.198147 Nov 28 01:05:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 343/1011] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:05:23 2023] DELETE /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments/f0dad8bc-bbd0-44e7-a817-7b1267b10aa2 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:05:23 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:23 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:23 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:23 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2e1919fa-0f7a-464f-bb98-bf7ef6b3ec31 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064723 Nov 28 01:05:23 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 331/1012] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:05:23 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9ab357-37c6-410c-919c-a144d4261ada", "name": "network-vif-plugged", "status": "completed", "tag": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:30 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:30 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] Creating event network-vif-plugged:c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance be9ab357-37c6-410c-919c-a144d4261ada on user Nov 28 01:05:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0c92a1cb-9c2d-4005-81e2-92abe50746f0 req-b63c84ed-0f0c-475c-a790-93989ef0caee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044997 Nov 28 01:05:30 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 339/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:05:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:32 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:32 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9ab357-37c6-410c-919c-a144d4261ada", "name": "network-vif-plugged", "status": "completed", "tag": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:05:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:32 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] Creating event network-vif-plugged:c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance be9ab357-37c6-410c-919c-a144d4261ada on user Nov 28 01:05:32 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4be178e7-a746-41e2-ba4a-058e79b27e08 req-c5481a76-d067-415b-9f11-4fb9bca7b7a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032759 Nov 28 01:05:32 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 344/1014] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:05:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:05:52 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-de97277b-0cb6-4bc7-b48b-240abab27f65 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '.version_select at 0x7f4972f9c280>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:52 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=10 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:52 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=16 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:52 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-de97277b-0cb6-4bc7-b48b-240abab27f65 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/images/a5699749-679c-437d-ba53-0bd7dd814a0e" status: 200 len: 1722 microversion: 2.1 time: 0.056646 Nov 28 01:05:52 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 332/1015] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 01:05:52 2023] GET /compute/v2.1/images/a5699749-679c-437d-ba53-0bd7dd814a0e => generated 1722 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:05:52 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:52 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=22 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:52 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7b8f931f-c5a3-4105-b8c3-3d2bd6ead8b0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '.version_select at 0x7f4972ff9630>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7b8f931f-c5a3-4105-b8c3-3d2bd6ead8b0 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/images/a5699749-679c-437d-ba53-0bd7dd814a0e" status: 200 len: 1722 microversion: 2.1 time: 0.062430 Nov 28 01:05:52 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 340/1016] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 01:05:52 2023] GET /compute/v2.1/images/a5699749-679c-437d-ba53-0bd7dd814a0e => generated 1722 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=16 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:05:52 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:05:53 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c3f1b52e54c41b4499cbc2b767419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc686f7daecb4843b4b0b4f1e89dec89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:05:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-bb18c6dc-3b56-45c4-9fd4-c788f3441e3b tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 200 len: 1668 microversion: 2.1 time: 0.518157 Nov 28 01:05:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 345/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:05:52 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 1668 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:00 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:06:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-a94ca07b-cd7f-40d2-ad5f-8ddddea14bd8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 200 len: 1491 microversion: 2.1 time: 0.220886 Nov 28 01:06:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 333/1018] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:06:00 2023] GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 1491 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:06:03 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:03 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-fd383c9d-8eee-4e81-b13d-e482969671ee tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050464 Nov 28 01:06:03 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 341/1019] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 01:06:03 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:04 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:06:04 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-465fb67d-f228-4b4b-b781-d26c2a3cb37c tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 204 len: 0 microversion: 2.20 time: 0.117761 Nov 28 01:06:04 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 346/1020] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 01:06:03 2023] DELETE /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-unplugged", "status": "completed", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:06:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:06:04 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fd50f4f867e4efcad9e16d45dde6df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c236f1599d4a4fb181b4aa73058211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:06:04 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-3d80fcaa-e0ae-4341-9e6e-2a981bedfa84 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 200 len: 1709 microversion: 2.20 time: 0.239197 Nov 28 01:06:04 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 334/1021] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:06:04 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 1709 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 01:06:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] Creating event network-vif-unplugged:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:06:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a8086ea5-b07d-469c-955e-65a4b207f4c6 req-6865a5a6-cc66-4819-91c0-bd8953dd8c7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036763 Nov 28 01:06:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 342/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:06:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:06:05 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-deleted", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:06:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] Creating event network-vif-deleted:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:06:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-667c768e-6efc-4075-bfba-b07d5641fa0b req-1b0e08f7-a36d-470e-9df1-16300d4551d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Nov 28 01:06:05 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 347/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:06:06 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050b6f-4cc9-45e8-81f0-56ef01c3f703", "name": "network-vif-plugged", "status": "completed", "tag": "c212acf4-cf66-4cc0-8038-45ad6868166b"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:06:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:06 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] Creating event network-vif-plugged:c212acf4-cf66-4cc0-8038-45ad6868166b for instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 on user Nov 28 01:06:06 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-70780688-646a-4805-b984-0daa149b9544 req-fee2ecc1-7425-437f-8844-4b61c5f0af94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034092 Nov 28 01:06:06 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 335/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:06:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:08 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:06:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-de59c1a2-4370-4db0-a956-4dcf13e6defd tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada" status: 200 len: 1438 microversion: 2.1 time: 0.231472 Nov 28 01:06:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 343/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:06:08 2023] GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada => generated 1438 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:06:13 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:13 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:13 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:13 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5eaa9b7e-666d-4989-9771-a1f281b262e9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043045 Nov 28 01:06:13 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 348/1026] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:06:13 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:13 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:06:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d3c85702-58b9-4e11-a409-85d0f6e621b3 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc" status: 204 len: 0 microversion: 2.1 time: 0.135236 Nov 28 01:06:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 336/1027] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:06:13 2023] DELETE /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4968288-fce2-45df-8ec1-9fc8b7db41cc", "name": "network-vif-unplugged", "status": "completed", "tag": "c54006a4-4d8f-444d-897a-419008313a91"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:06:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] Creating event network-vif-unplugged:c54006a4-4d8f-444d-897a-419008313a91 for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc on user Nov 28 01:06:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-ded80fdb-11d7-43a2-b887-0398f96c9742 req-5a52e946-a42d-4f67-b028-94088606f87b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030309 Nov 28 01:06:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 349/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:06:14 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:06:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6e9e8333-dc22-4d5f-9265-7e042509064c tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc" status: 200 len: 1668 microversion: 2.1 time: 0.253311 Nov 28 01:06:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 344/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:06:14 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc => generated 1668 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 01:06:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4968288-fce2-45df-8ec1-9fc8b7db41cc", "name": "network-vif-plugged", "status": "completed", "tag": "c54006a4-4d8f-444d-897a-419008313a91"}, {"server_uuid": "a4968288-fce2-45df-8ec1-9fc8b7db41cc", "name": "network-vif-deleted", "tag": "c54006a4-4d8f-444d-897a-419008313a91"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:06:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Creating event network-vif-plugged:c54006a4-4d8f-444d-897a-419008313a91 for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc on user Nov 28 01:06:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] Creating event network-vif-deleted:c54006a4-4d8f-444d-897a-419008313a91 for instance a4968288-fce2-45df-8ec1-9fc8b7db41cc on user Nov 28 01:06:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-2ce5f9ac-166a-411d-be6b-46db541f5a25 req-5eaced5e-05a4-47cb-8fd1-c9afd75cd566 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031360 Nov 28 01:06:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 337/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:06:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:53 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c3f1b52e54c41b4499cbc2b767419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc686f7daecb4843b4b0b4f1e89dec89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:06:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5cd0b1ca-1a02-45e1-8954-c8da8940b2b4 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 200 len: 1668 microversion: 2.1 time: 0.230576 Nov 28 01:06:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 350/1031] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:06:53 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 1668 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=20 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:54 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-06d58742-c0af-46bc-91c6-53a5f5190cfd tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316583 Nov 28 01:06:54 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 345/1032] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:06:53 2023] POST /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] HTTP exception thrown: Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 could not be found. Nov 28 01:06:54 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Returning 404 to user: Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:06:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2a8b172c-8a5b-4864-a9a4-79fe3bf0dc16 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 404 len: 111 microversion: 2.20 time: 0.040563 Nov 28 01:06:54 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 338/1033] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:06:54 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:06:54 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-636188ba-0389-483a-8138-7b5020ac6424 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '.version_select at 0x7f4972fd1990>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:54 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-636188ba-0389-483a-8138-7b5020ac6424 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399423202" status: 204 len: 0 microversion: 2.20 time: 0.022792 Nov 28 01:06:54 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 351/1034] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 01:06:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399423202 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] HTTP exception thrown: Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 could not be found. Nov 28 01:06:58 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Returning 404 to user: Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:06:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2a5dc417-a031-4db4-9327-9432f5ad82e7 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 404 len: 111 microversion: 2.20 time: 0.031855 Nov 28 01:06:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 346/1035] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 01:06:58 2023] DELETE /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 15050b6f-4cc9-45e8-81f0-56ef01c3f703] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:06:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] HTTP exception thrown: Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 could not be found. Nov 28 01:06:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Returning 404 to user: Instance 15050b6f-4cc9-45e8-81f0-56ef01c3f703 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:06:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-4dd13aeb-f1c1-4dd1-a5b2-a42eeb1a711a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703" status: 404 len: 111 microversion: 2.20 time: 0.029364 Nov 28 01:06:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 339/1036] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:06:58 2023] GET /compute/v2.1/servers/15050b6f-4cc9-45e8-81f0-56ef01c3f703 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] HTTP exception thrown: Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e could not be found. Nov 28 01:07:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Returning 404 to user: Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:07:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-81773f87-1101-470d-955c-b970b5a30f4a tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 404 len: 111 microversion: 2.20 time: 0.027215 Nov 28 01:07:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 352/1037] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 01:07:01 2023] DELETE /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] [instance: 5fcab10a-4f5f-479c-9d0c-907bcea7d87e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] HTTP exception thrown: Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e could not be found. Nov 28 01:07:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] Returning 404 to user: Instance 5fcab10a-4f5f-479c-9d0c-907bcea7d87e could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:07:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-01f5d6e6-b451-4350-9b16-b08f7902e448 tempest-AttachVolumeShelveTestJSON-107867446 tempest-AttachVolumeShelveTestJSON-107867446-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e" status: 404 len: 111 microversion: 2.20 time: 0.030797 Nov 28 01:07:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 347/1038] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 01:07:01 2023] GET /compute/v2.1/servers/5fcab10a-4f5f-479c-9d0c-907bcea7d87e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:07:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-dcf82a5b-4d98-4539-979d-7e244d04a7d8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1722696686", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0eca691f-8ae7-4ede-a543-e4f526783da7", "destination_type": "local"}, {"source_type": "volume", "uuid": "d58233f4-55ef-4ff8-8b73-9b719a17c713", "destination_type": "invalid"}], "networks": [{"uuid": "860d6281-89e3-48fc-9050-984da4b55006"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-dcf82a5b-4d98-4539-979d-7e244d04a7d8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:07:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-dcf82a5b-4d98-4539-979d-7e244d04a7d8 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.008070 Nov 28 01:07:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 340/1039] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:07:02 2023] POST /compute/v2.1/servers => generated 155 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 01:07:02 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:02 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:03 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:07:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-d2969634-da6b-447e-95a9-9166fb919114 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 200 len: 1491 microversion: 2.1 time: 0.218187 Nov 28 01:07:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 353/1040] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:02 2023] GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 1491 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc could not be found. Nov 28 01:07:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:07:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-12b3bbfb-5779-45ff-9b8e-3c82b3ea9b4b tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc" status: 404 len: 111 microversion: 2.1 time: 0.168619 Nov 28 01:07:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 348/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:04 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:07:04 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-32661e7e-d48e-446c-8570-630e00ee6065 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '.version_select at 0x7f49731485e0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:04 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-32661e7e-d48e-446c-8570-630e00ee6065 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774369941" status: 202 len: 0 microversion: 2.1 time: 0.023484 Nov 28 01:07:04 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 341/1042] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 01:07:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774369941 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "a5699749-679c-437d-ba53-0bd7dd814a0e"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:05 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'flavor' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:07:05 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2cef3f6a-9e62-4a1c-b217-ebe1e81d0f6a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: .version_select at 0x7f4972ffa320>, body: {"keypair": {"name": "tempest-keypair-999610924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Bif8Ci23xJcv9z5EuVRGxlOGUZH9fj6PTcDLBbUIMNlihJb6dbPYGFWzdhVdwA5Fyx3DTUzSjNQb/pku2R6dtjeUzOYC2K2XJ4k0oV/7suMrccXQu13Ru5JBaEyqmDA=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:05 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-2cef3f6a-9e62-4a1c-b217-ebe1e81d0f6a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:07:05 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-2cef3f6a-9e62-4a1c-b217-ebe1e81d0f6a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for user 6692115b7e8042c38fb8ecb84a5af250 and project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:07:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-03b3e013-b0ce-4bdd-b2bb-eb6ada0d46c3 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/action" status: 200 len: 29 microversion: 2.1 time: 0.238495 Nov 28 01:07:05 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 354/1043] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:07:05 2023] POST /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/action => generated 29 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:05 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2cef3f6a-9e62-4a1c-b217-ebe1e81d0f6a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051931 Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:05 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 349/1044] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:07:05 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:05 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c3f1b52e54c41b4499cbc2b767419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc686f7daecb4843b4b0b4f1e89dec89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:07:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c804fda3-0d04-4d2c-b01f-3b840aae1109 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 200 len: 1720 microversion: 2.1 time: 0.552143 Nov 28 01:07:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 342/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:05 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 1720 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:07:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-unplugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] Creating event network-vif-unplugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:07:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-ee5c6183-2c45-4731-b2d6-21d071246b91 req-22132cdc-0d18-464c-a512-bc2ad9199554 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033516 Nov 28 01:07:06 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 355/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-200637594", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "17b52fdf-8b78-4226-b39e-12aa8c2e462a"}], "security_groups": [{"name": "tempest-securitygroup--817549308"}], "key_name": "tempest-keypair-999610924", "user_data": "}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:07 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] validate_networks() for [('17b52fdf-8b78-4226-b39e-12aa8c2e462a', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Getting quotas for user 6692115b7e8042c38fb8ecb84a5af250 and project 45ead1a8b36544df9a2bf0feb223ba62. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:07:08 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:07:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7a68249e-21f7-4582-993d-bd82f562f5a2 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.210865 Nov 28 01:07:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 350/1047] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:07:07 2023] POST /compute/v2.1/servers => generated 399 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:07:08 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d3fa9000-aec8-4b2f-a79a-a10f468b8321 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:08 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d3fa9000-aec8-4b2f-a79a-a10f468b8321 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:07:08 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-d3fa9000-aec8-4b2f-a79a-a10f468b8321 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:07:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-95923bbf-c55c-483a-b0cf-137f02942926 req-e95cf4f5-dcc5-48eb-99ed-1e14e08ea04e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028975 Nov 28 01:07:08 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 356/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:08 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d3fa9000-aec8-4b2f-a79a-a10f468b8321 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180" status: 200 len: 1232 microversion: 2.1 time: 0.062287 Nov 28 01:07:08 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 343/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:08 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180 => generated 1232 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:09 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:07:09 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-405dcdec-0565-4827-81bf-f07e54c74727 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada" status: 200 len: 1438 microversion: 2.1 time: 0.393797 Nov 28 01:07:09 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 351/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:09 2023] GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada => generated 1438 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:07:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9ab357-37c6-410c-919c-a144d4261ada", "tag": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] Creating event network-changed:c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance be9ab357-37c6-410c-919c-a144d4261ada on user Nov 28 01:07:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-9bd52345-f7ee-4fc2-9264-20bb1d01c6c7 req-8e80f3fb-e5d7-4398-a8e2-f8d836e2c171 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073985 Nov 28 01:07:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 357/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:11 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:11 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:07:11 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-fab6a7d7-a667-4fa4-b9be-552fef02203b req-f0258b81-0d7c-4bd1-9ea7-4700b2ab038c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052016 Nov 28 01:07:11 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 344/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:13 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e025c3f-82f4-4b22-9429-50dd93b3b180", "tag": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401"}, {"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Creating event network-changed:60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 on user Nov 28 01:07:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:07:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-8bd80920-7919-4d96-a197-b05fe5bb99b8 req-3498665d-01e8-41b7-98f1-35ee6b147161 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042711 Nov 28 01:07:13 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 352/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:13 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e025c3f-82f4-4b22-9429-50dd93b3b180", "name": "network-vif-plugged", "status": "completed", "tag": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] Creating event network-vif-plugged:60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 on user Nov 28 01:07:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-19968421-63f4-4178-9d93-31f02237053e req-66d20eb7-b123-45b7-baef-e0b83ee97011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044467 Nov 28 01:07:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 358/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e025c3f-82f4-4b22-9429-50dd93b3b180", "name": "network-vif-plugged", "status": "completed", "tag": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] Creating event network-vif-plugged:60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 on user Nov 28 01:07:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-d352e076-56b2-486d-b041-2a7b22fa811b req-b1e1c000-64b8-44e5-bc0a-c8deb1fbbe7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055451 Nov 28 01:07:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 345/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-692539590", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-27195325"}], "block_device_mapping_v2": [{"uuid": "ff347484-a484-4b80-a268-ad03926574fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-832294225", "networks": [{"uuid": "e7a9c673-be29-4f27-b00a-34793dbf68b7"}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] validate_networks() for [('e7a9c673-be29-4f27-b00a-34793dbf68b7', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:18 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:07:18 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Getting quotas for user 76463cfb4f9c4edd908a0dc57546bb3a and project 5fd11e875f8544b495ef779a772b8a27. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:07:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:07:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff347484-a484-4b80-a268-ad03926574fb',volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:07:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-220bd87e-2cbd-4304-8e97-8abcd01ba297 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.980168 Nov 28 01:07:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 353/1056] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:07:17 2023] POST /compute/v2.1/servers => generated 402 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:07:18 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-05e1462b-fc84-4be7-955f-35ceece5cbd6 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:18 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-05e1462b-fc84-4be7-955f-35ceece5cbd6 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:18 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-05e1462b-fc84-4be7-955f-35ceece5cbd6 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:07:18 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-05e1462b-fc84-4be7-955f-35ceece5cbd6 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae" status: 200 len: 1086 microversion: 2.1 time: 0.094309 Nov 28 01:07:18 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 359/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:18 2023] GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae => generated 1086 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:07:21 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:21 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae55cefb-c823-469a-9d62-e12005dfa9ae", "tag": "be140d63-c2f7-4dfa-a2b4-83eb888ce731"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:21 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:21 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] Creating event network-changed:be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance ae55cefb-c823-469a-9d62-e12005dfa9ae on user Nov 28 01:07:21 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-20461a41-125b-48e1-922f-7231188785ee req-9e5838fd-9e54-40a1-92d6-07da4a222e70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054876 Nov 28 01:07:21 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 346/1058] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=16 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae55cefb-c823-469a-9d62-e12005dfa9ae", "name": "network-vif-plugged", "status": "completed", "tag": "be140d63-c2f7-4dfa-a2b4-83eb888ce731"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] Creating event network-vif-plugged:be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance ae55cefb-c823-469a-9d62-e12005dfa9ae on user Nov 28 01:07:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-c51001b0-1422-41c1-b4d4-74ff88dbdaa9 req-744cf495-4133-4d6f-ae6c-c3d612c829d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054229 Nov 28 01:07:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 354/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae55cefb-c823-469a-9d62-e12005dfa9ae", "name": "network-vif-plugged", "status": "completed", "tag": "be140d63-c2f7-4dfa-a2b4-83eb888ce731"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] Creating event network-vif-plugged:be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance ae55cefb-c823-469a-9d62-e12005dfa9ae on user Nov 28 01:07:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-4a4f7b46-7b66-4287-918a-c69db68cb4d3 req-957d064b-8ea1-4f0f-846b-c90999f11e56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045643 Nov 28 01:07:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 360/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=16 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1974536440", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "07239a8a-ca6d-4bd7-98d4-a5efe6ca827a"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] validate_networks() for [('07239a8a-ca6d-4bd7-98d4-a5efe6ca827a', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Getting quotas for project 230df1c12b5a408b81c364b1da501b59. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:07:37 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Getting quotas for user cab44b27feeb477a92838fade4c11fa8 and project 230df1c12b5a408b81c364b1da501b59. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:07:38 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:07:38 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:07:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-246ae994-29c2-4502-89a9-9be86de6a67c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.828655 Nov 28 01:07:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 347/1061] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:07:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:07:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-b5695da7-9b40-46c1-a37d-608773ded9a3 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:38 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-b5695da7-9b40-46c1-a37d-608773ded9a3 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:38 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-b5695da7-9b40-46c1-a37d-608773ded9a3 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab44b27feeb477a92838fade4c11fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230df1c12b5a408b81c364b1da501b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:07:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-b5695da7-9b40-46c1-a37d-608773ded9a3 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a" status: 200 len: 1206 microversion: 2.1 time: 0.069303 Nov 28 01:07:38 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 355/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:38 2023] GET /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a => generated 1206 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:07:40 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "658d11ca-16ef-48c4-9c87-78b338c5ab2a", "tag": "dffd1c11-03f9-411c-b673-9954417d6307"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:40 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:40 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] Creating event network-changed:dffd1c11-03f9-411c-b673-9954417d6307 for instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a on user Nov 28 01:07:40 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-7aaf0744-f327-4b9f-b24f-dbf6618f0727 req-517b146f-b42e-46ac-b42f-98383d800d0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102086 Nov 28 01:07:40 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 361/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658d11ca-16ef-48c4-9c87-78b338c5ab2a", "name": "network-vif-plugged", "status": "completed", "tag": "dffd1c11-03f9-411c-b673-9954417d6307"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] Creating event network-vif-plugged:dffd1c11-03f9-411c-b673-9954417d6307 for instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a on user Nov 28 01:07:42 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-86501ca8-45ae-4e77-8cc3-a4419c45eb9b req-43d58352-8c5c-4428-b855-3a3fa19148ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035962 Nov 28 01:07:42 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 348/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658d11ca-16ef-48c4-9c87-78b338c5ab2a", "name": "network-vif-plugged", "status": "completed", "tag": "dffd1c11-03f9-411c-b673-9954417d6307"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:07:44 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] Creating event network-vif-plugged:dffd1c11-03f9-411c-b673-9954417d6307 for instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a on user Nov 28 01:07:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-1a7ace0c-f8f3-4135-849e-13a4ec7d95de req-d301deee-a604-493b-bf36-6a6ddbbcffd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038981 Nov 28 01:07:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 356/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:56 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c3f1b52e54c41b4499cbc2b767419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc686f7daecb4843b4b0b4f1e89dec89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:07:56 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-938fd3aa-2124-4e60-994e-cab49a43f98f tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 200 len: 1700 microversion: 2.1 time: 0.240755 Nov 28 01:07:56 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 362/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:55 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 1700 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:07:58 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:07:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-69c6f951-b73b-47b9-9fbc-aba5246b4a0d tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180" status: 200 len: 1541 microversion: 2.1 time: 0.223455 Nov 28 01:07:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 349/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:07:58 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180 => generated 1541 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:08 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:08:08 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0b6909d7-f7d3-4c92-b1dc-5c98971b0da1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae" status: 200 len: 1437 microversion: 2.1 time: 0.284997 Nov 28 01:08:08 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 357/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:08:08 2023] GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae => generated 1437 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:09 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] HTTP exception thrown: Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f could not be found. Nov 28 01:08:09 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Returning 404 to user: Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:08:09 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-d8cebd65-5815-4fd7-ae12-5dbe71e2797c tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f" status: 404 len: 111 microversion: 2.1 time: 0.029994 Nov 28 01:08:09 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 363/1069] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:08:09 2023] DELETE /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: f336a024-e3e9-4ac1-9aad-a7e1d465253f] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] HTTP exception thrown: Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f could not be found. Nov 28 01:08:09 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Returning 404 to user: Instance f336a024-e3e9-4ac1-9aad-a7e1d465253f could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:08:09 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f0555405-5a72-4d25-a704-09aea7cbfafd tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f" status: 404 len: 111 microversion: 2.1 time: 0.036322 Nov 28 01:08:09 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 350/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:08:09 2023] GET /compute/v2.1/servers/f336a024-e3e9-4ac1-9aad-a7e1d465253f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:09 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:08:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7a2f905b-0fe6-4611-b7fe-d62324c6bb10 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 204 len: 0 microversion: 2.1 time: 0.125843 Nov 28 01:08:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 358/1071] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:08:09 2023] DELETE /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b375c38b-e368-4e2a-b988-0ae27130a878", "name": "network-vif-unplugged", "status": "completed", "tag": "cbe5cb94-844b-4115-a79a-e58beb743d42"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:08:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:10 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679237c178f427a9cc7887c21fe12cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf19f7d462f4fa2a9204479d1d35811', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:08:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] Creating event network-vif-unplugged:cbe5cb94-844b-4115-a79a-e58beb743d42 for instance b375c38b-e368-4e2a-b988-0ae27130a878 on user Nov 28 01:08:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-49d4e3ea-2341-49e6-8747-de4cf81fcedf req-152396b8-5d1d-45b9-a03f-7e7d16533f6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028969 Nov 28 01:08:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 351/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:08:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:08:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-982e7e48-c346-4195-905d-203cfa9e3139 tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 200 len: 1497 microversion: 2.1 time: 0.403631 Nov 28 01:08:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 364/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:08:10 2023] GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 1497 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:08:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b375c38b-e368-4e2a-b988-0ae27130a878", "name": "network-vif-plugged", "status": "completed", "tag": "cbe5cb94-844b-4115-a79a-e58beb743d42"}, {"server_uuid": "b375c38b-e368-4e2a-b988-0ae27130a878", "name": "network-vif-deleted", "tag": "cbe5cb94-844b-4115-a79a-e58beb743d42"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:08:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Creating event network-vif-plugged:cbe5cb94-844b-4115-a79a-e58beb743d42 for instance b375c38b-e368-4e2a-b988-0ae27130a878 on user Nov 28 01:08:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] Creating event network-vif-deleted:cbe5cb94-844b-4115-a79a-e58beb743d42 for instance b375c38b-e368-4e2a-b988-0ae27130a878 on user Nov 28 01:08:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0f298be1-77e7-46b2-b848-719ba5b9946f req-06ae6bec-6466-4593-b833-5c250caab395 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038655 Nov 28 01:08:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 359/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:28 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab44b27feeb477a92838fade4c11fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230df1c12b5a408b81c364b1da501b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:08:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b875cdfe-a7d7-4d30-a612-dde311a1cdde tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a" status: 200 len: 1485 microversion: 2.1 time: 0.219137 Nov 28 01:08:28 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 352/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:08:28 2023] GET /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a => generated 1485 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:56 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:56 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5d2266ad-63eb-4eec-8017-3ea747bf7c2a tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/action" status: 202 len: 0 microversion: 2.1 time: 0.195097 Nov 28 01:08:56 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 365/1076] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:08:56 2023] POST /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:56 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:56 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-617c6c48-cab5-4634-a60f-7df507a2a5c5 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.196568 Nov 28 01:08:56 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 360/1077] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:08:56 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-interface => generated 282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:08:57 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-unplugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:08:57 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:57 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:08:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:57 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:57 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] Creating event network-vif-unplugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:57 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-b35ab764-67ce-474f-a452-d99af280d678 req-fd5523a4-043d-452c-acb4-ba21cd8cdca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036536 Nov 28 01:08:57 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 353/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:08:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:08:57 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:08:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:57 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] Creating event network-changed:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:57 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-7e3620af-f45b-4920-bc9d-06cbfdeaabd7 req-9905f959-1d47-4130-88a8-9743569a6f84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108921 Nov 28 01:08:57 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 366/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:08:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:08:58 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:08:58 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:08:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c211ad9a-cec3-4281-8f8e-55fffa475e83 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.181219 Nov 28 01:08:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 361/1080] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:08:58 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-interface => generated 283 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:08:59 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}, {"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}, {"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}, {"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-unplugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}, {"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}, {"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:08:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Creating event network-vif-unplugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-e47949bc-b70c-4c4a-8a6b-68525be7f084 req-cdeb2378-c3aa-4be6-9464-29950686b925 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.062619 Nov 28 01:08:59 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 354/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:08:59 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:08:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:08:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:08:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:08:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] Creating event network-changed:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:08:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-8424a492-814d-4dae-87d0-97710e9e7511 req-8ffb2eb4-f98a-4929-97c1-0a777d61eba0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035234 Nov 28 01:08:59 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 367/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:08:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:00 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-079669af-b070-4d92-8977-668eccb483b7 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/ips" status: 200 len: 108 microversion: 2.1 time: 0.039125 Nov 28 01:09:00 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 362/1083] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 01:09:00 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] [instance: b375c38b-e368-4e2a-b988-0ae27130a878] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] HTTP exception thrown: Instance b375c38b-e368-4e2a-b988-0ae27130a878 could not be found. Nov 28 01:09:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] Returning 404 to user: Instance b375c38b-e368-4e2a-b988-0ae27130a878 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:09:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-21760a56-b7c9-46d6-aa5a-371deb4cd4dc tempest-ServersNegativeTestJSON-647957928 tempest-ServersNegativeTestJSON-647957928-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878" status: 404 len: 111 microversion: 2.1 time: 0.034389 Nov 28 01:09:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 355/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:09:00 2023] GET /compute/v2.1/servers/b375c38b-e368-4e2a-b988-0ae27130a878 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:09:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e025c3f-82f4-4b22-9429-50dd93b3b180", "tag": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:09:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:09:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] Creating event network-changed:60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 on user Nov 28 01:09:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:09:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-48db817c-1303-469a-8c9c-677099d9521c req-35abfdbb-2d47-4ffe-b8c3-0de3e63e6f6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031269 Nov 28 01:09:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 368/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-87f99a62-02e1-4f64-9eba-e909dbccb5dc req-367a0c2e-75d5-4f71-a67f-0203e186fe09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028067 Nov 28 01:09:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 363/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "952b1555-fe5c-463e-8cf2-75378239fadb"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:09:02 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-d7670ca4-68a6-43f4-b9d7-63c66f0a3e69 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296266 Nov 28 01:09:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 356/1087] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:09:02 2023] POST /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:08 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:09 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:09:09 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-287e2a61-e462-455b-8cd7-850008df84f1 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae" status: 200 len: 1437 microversion: 2.1 time: 0.231925 Nov 28 01:09:09 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 369/1088] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:09:08 2023] GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae => generated 1437 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:09:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae55cefb-c823-469a-9d62-e12005dfa9ae", "tag": "be140d63-c2f7-4dfa-a2b4-83eb888ce731"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:09:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] Creating event network-changed:be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance ae55cefb-c823-469a-9d62-e12005dfa9ae on user Nov 28 01:09:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-582a32f2-fc66-4901-b788-e17eab185133 req-4d8d89b9-a2b0-4c4f-b0ed-ff7fc32b4957 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031938 Nov 28 01:09:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 364/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:09:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae55cefb-c823-469a-9d62-e12005dfa9ae", "tag": "be140d63-c2f7-4dfa-a2b4-83eb888ce731"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:09:12 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:12 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] Creating event network-changed:be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance ae55cefb-c823-469a-9d62-e12005dfa9ae on user Nov 28 01:09:12 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-136d5932-ab18-473b-ac93-5354a83e6a30 req-7265edce-8e69-4ce9-b82b-db67623a7fa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048966 Nov 28 01:09:12 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 370/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:09:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:12 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b4b59bb5-4cce-40ca-b250-8b8db60b8e57 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae" status: 204 len: 0 microversion: 2.1 time: 0.162882 Nov 28 01:09:12 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 357/1091] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:09:12 2023] DELETE /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:12 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lazy-loading 'services' on Instance uuid 7e025c3f-82f4-4b22-9429-50dd93b3b180 {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:09:12 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:09:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0715d75d-53ad-48a0-a7d4-0579d4b73384 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae" status: 200 len: 1562 microversion: 2.1 time: 0.349987 Nov 28 01:09:13 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 365/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:09:12 2023] GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae => generated 1562 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:09:13 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f5a7efe1-f6de-4c86-96df-f4f0ac99a5cd tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-volume_attachments/952b1555-fe5c-463e-8cf2-75378239fadb" status: 202 len: 0 microversion: 2.1 time: 0.187606 Nov 28 01:09:13 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 371/1093] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:09:12 2023] DELETE /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-volume_attachments/952b1555-fe5c-463e-8cf2-75378239fadb => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:09:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:13 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f6e9f9e2-15b9-4987-8716-1e1248b10654 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051122 Nov 28 01:09:13 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 358/1094] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:09:13 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae55cefb-c823-469a-9d62-e12005dfa9ae", "name": "network-vif-unplugged", "status": "completed", "tag": "be140d63-c2f7-4dfa-a2b4-83eb888ce731"}, {"server_uuid": "ae55cefb-c823-469a-9d62-e12005dfa9ae", "name": "network-vif-plugged", "status": "completed", "tag": "be140d63-c2f7-4dfa-a2b4-83eb888ce731"}, {"server_uuid": "ae55cefb-c823-469a-9d62-e12005dfa9ae", "name": "network-vif-deleted", "tag": "be140d63-c2f7-4dfa-a2b4-83eb888ce731"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:09:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Creating event network-vif-unplugged:be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance ae55cefb-c823-469a-9d62-e12005dfa9ae on user Nov 28 01:09:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Creating event network-vif-plugged:be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance ae55cefb-c823-469a-9d62-e12005dfa9ae on user Nov 28 01:09:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] Creating event network-vif-deleted:be140d63-c2f7-4dfa-a2b4-83eb888ce731 for instance ae55cefb-c823-469a-9d62-e12005dfa9ae on user Nov 28 01:09:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5920cf08-66e9-4a47-b1f8-5943d8dec55b req-a9e4f4ac-83ee-46ca-8ea0-54a60c2d3fd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.086791 Nov 28 01:09:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 366/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:09:14 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=14 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:29 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lazy-loading 'services' on Instance uuid cb931a0c-8094-497e-a63b-676c763d5f44 {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:09:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6da9ecdf-9c12-42be-ac68-5bb976fec0f6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-volume_attachments/8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4" status: 202 len: 0 microversion: 2.1 time: 0.243056 Nov 28 01:09:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 372/1096] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:09:29 2023] DELETE /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-volume_attachments/8f3c94f0-33d9-4c66-9a0e-fc1e992ecfd4 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:29 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:29 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-048cea4d-885f-4abf-8807-c068c22e12d1 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064219 Nov 28 01:09:29 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 359/1097] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:09:29 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=14 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=24 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:35 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:09:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-80505063-b4c5-4e2c-9ed1-9f608d7c40ef tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a" status: 204 len: 0 microversion: 2.1 time: 0.196622 Nov 28 01:09:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 367/1098] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:09:35 2023] DELETE /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:09:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:09:35 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:09:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658d11ca-16ef-48c4-9c87-78b338c5ab2a", "name": "network-vif-unplugged", "status": "completed", "tag": "dffd1c11-03f9-411c-b673-9954417d6307"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:09:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:35 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] Creating event network-vif-unplugged:dffd1c11-03f9-411c-b673-9954417d6307 for instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a on user Nov 28 01:09:36 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab44b27feeb477a92838fade4c11fa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230df1c12b5a408b81c364b1da501b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:09:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-3e68ed67-3bd0-4fc3-a905-8349c963aa64 req-39a35fe2-c421-4192-9100-124537291a38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044541 Nov 28 01:09:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 360/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:09:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:09:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-afcf21b1-9a3a-4c00-9c64-b08d3ebf9497 tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a" status: 200 len: 1491 microversion: 2.1 time: 0.321332 Nov 28 01:09:36 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 373/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:09:35 2023] GET /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a => generated 1491 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:09:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "658d11ca-16ef-48c4-9c87-78b338c5ab2a", "name": "network-vif-plugged", "status": "completed", "tag": "dffd1c11-03f9-411c-b673-9954417d6307"}, {"server_uuid": "658d11ca-16ef-48c4-9c87-78b338c5ab2a", "name": "network-vif-deleted", "tag": "dffd1c11-03f9-411c-b673-9954417d6307"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:09:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:09:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:09:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:09:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Creating event network-vif-plugged:dffd1c11-03f9-411c-b673-9954417d6307 for instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a on user Nov 28 01:09:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] Creating event network-vif-deleted:dffd1c11-03f9-411c-b673-9954417d6307 for instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a on user Nov 28 01:09:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-ba725674-5561-4774-ba11-cad60120fafe req-3bb6c5e5-457a-4d80-a131-19f76354bca1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042717 Nov 28 01:09:38 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 368/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:09:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-abc9f59b-56ea-4b15-96cf-c44d916141c8 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048874 Nov 28 01:10:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 374/1102] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:10:03 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: ae55cefb-c823-469a-9d62-e12005dfa9ae] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance ae55cefb-c823-469a-9d62-e12005dfa9ae could not be found. Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance ae55cefb-c823-469a-9d62-e12005dfa9ae could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:10:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-fcaa18f5-6025-48b7-9ff8-e9caee996afa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae" status: 404 len: 111 microversion: 2.1 time: 0.210460 Nov 28 01:10:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 361/1103] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:10:03 2023] GET /compute/v2.1/servers/ae55cefb-c823-469a-9d62-e12005dfa9ae => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:10:03 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:10:03 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6863c5c7-7518-41b4-89dd-8a6e0e2311b9 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180" status: 204 len: 0 microversion: 2.1 time: 0.116617 Nov 28 01:10:03 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 369/1104] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:10:03 2023] DELETE /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e025c3f-82f4-4b22-9429-50dd93b3b180", "name": "network-vif-unplugged", "status": "completed", "tag": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:10:03 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6692115b7e8042c38fb8ecb84a5af250', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ead1a8b36544df9a2bf0feb223ba62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:03 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-dd1ec51a-601e-4687-82d7-ebffff3b19ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180" status: 200 len: 1665 microversion: 2.1 time: 0.250731 Nov 28 01:10:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 375/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:10:03 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180 => generated 1665 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:10:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] Creating event network-vif-unplugged:60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 on user Nov 28 01:10:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-5098bbf0-58d8-427a-a51c-b53d2d6308d1 req-649b7506-18f7-4f0a-9469-a469b62b807b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038844 Nov 28 01:10:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 362/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:10:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:10:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-c3324c30-0204-4863-a07c-0c4daf8889f7 req-5f678977-5a6a-499c-b05e-8f90ebaae87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e025c3f-82f4-4b22-9429-50dd93b3b180", "name": "network-vif-deleted", "tag": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:10:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c3324c30-0204-4863-a07c-0c4daf8889f7 req-5f678977-5a6a-499c-b05e-8f90ebaae87c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c3324c30-0204-4863-a07c-0c4daf8889f7 req-5f678977-5a6a-499c-b05e-8f90ebaae87c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-c3324c30-0204-4863-a07c-0c4daf8889f7 req-5f678977-5a6a-499c-b05e-8f90ebaae87c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-c3324c30-0204-4863-a07c-0c4daf8889f7 req-5f678977-5a6a-499c-b05e-8f90ebaae87c service nova] Creating event network-vif-deleted:60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 on user Nov 28 01:10:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-c3324c30-0204-4863-a07c-0c4daf8889f7 req-5f678977-5a6a-499c-b05e-8f90ebaae87c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035746 Nov 28 01:10:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 370/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:10:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:10:05 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e025c3f-82f4-4b22-9429-50dd93b3b180", "name": "network-vif-plugged", "status": "completed", "tag": "60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:10:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:05 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] Creating event network-vif-plugged:60c1f0ee-953d-4fc5-bba3-0b1dd7b3f401 for instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 on user Nov 28 01:10:05 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-b6632708-c65d-4d27-968b-d2ea43c5f174 req-8df1735f-086d-406e-a324-7b78f1829cb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029525 Nov 28 01:10:05 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 376/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:10:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:10 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9ab357-37c6-410c-919c-a144d4261ada", "tag": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:10 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] Creating event network-changed:c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance be9ab357-37c6-410c-919c-a144d4261ada on user Nov 28 01:10:10 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:10:10 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-fd981a8b-0a98-4e01-a59f-8240cbf14aff req-87223631-3df9-4286-9cfe-7cb356948817 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031339 Nov 28 01:10:10 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 371/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:10:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:10:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-6a8ab322-2b93-43fd-9ab3-61c98aea000f tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada" status: 204 len: 0 microversion: 2.1 time: 0.114914 Nov 28 01:10:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 363/1110] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:10:10 2023] DELETE /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:10:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:11 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76463cfb4f9c4edd908a0dc57546bb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd11e875f8544b495ef779a772b8a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:10:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-1951e8f9-8541-4f1f-952e-874140423999 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada" status: 200 len: 1562 microversion: 2.1 time: 0.500423 Nov 28 01:10:11 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 377/1111] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:10:10 2023] GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada => generated 1562 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:10:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9ab357-37c6-410c-919c-a144d4261ada", "name": "network-vif-unplugged", "status": "completed", "tag": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7"}, {"server_uuid": "be9ab357-37c6-410c-919c-a144d4261ada", "name": "network-vif-plugged", "status": "completed", "tag": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7"}, {"server_uuid": "be9ab357-37c6-410c-919c-a144d4261ada", "name": "network-vif-deleted", "tag": "c9a1e437-bf6a-4ce6-a156-37a6e3d251d7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:10:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:12 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Creating event network-vif-unplugged:c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance be9ab357-37c6-410c-919c-a144d4261ada on user Nov 28 01:10:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Creating event network-vif-plugged:c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance be9ab357-37c6-410c-919c-a144d4261ada on user Nov 28 01:10:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] Creating event network-vif-deleted:c9a1e437-bf6a-4ce6-a156-37a6e3d251d7 for instance be9ab357-37c6-410c-919c-a144d4261ada on user Nov 28 01:10:12 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-8d890635-cd16-44e5-a2d3-064a78ce317a req-2c0b87e4-b44d-40f7-ba57-fdb1b49f4230 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.031118 Nov 28 01:10:12 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 372/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:10:12 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-76e28b05-3004-4100-a42f-f59df678e211 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050046 Nov 28 01:10:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 364/1113] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:10:19 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:10:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-78fc20f5-4c3c-4b16-b3fb-ce87631546d9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '.version_select at 0x7f4972fd1510>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-78fc20f5-4c3c-4b16-b3fb-ce87631546d9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/a5699749-679c-437d-ba53-0bd7dd814a0e" status: 204 len: 0 microversion: 2.1 time: 0.226667 Nov 28 01:10:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 378/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:10:19 2023] DELETE /compute/v2.1/images/a5699749-679c-437d-ba53-0bd7dd814a0e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:19 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:10:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-fadde3ac-ef4b-4dea-9bc8-7bcdc0d2bbb9 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 204 len: 0 microversion: 2.1 time: 0.136241 Nov 28 01:10:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 373/1115] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:10:19 2023] DELETE /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:20 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-unplugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:10:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:20 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c3f1b52e54c41b4499cbc2b767419', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc686f7daecb4843b4b0b4f1e89dec89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:10:20 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e4f0dbf1-9b75-4eb9-a7db-1798f3dd2a83 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 200 len: 1674 microversion: 2.1 time: 0.314798 Nov 28 01:10:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 365/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:10:19 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 1674 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:10:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] Creating event network-vif-unplugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:10:20 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-19a62ab1-90a6-426f-a85a-1dbdcf8931e9 req-2b3aa63d-f735-4307-911b-ee91424b9f98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043419 Nov 28 01:10:20 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 379/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:10:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-plugged", "status": "completed", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}, {"server_uuid": "cb931a0c-8094-497e-a63b-676c763d5f44", "name": "network-vif-deleted", "tag": "ebf2a135-0f75-4334-9e00-ee1e757402cc"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:10:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Creating event network-vif-plugged:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:10:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] Creating event network-vif-deleted:ebf2a135-0f75-4334-9e00-ee1e757402cc for instance cb931a0c-8094-497e-a63b-676c763d5f44 on user Nov 28 01:10:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-1d3cf560-9f2f-4668-9ab1-0ff337973f97 req-20090a64-f72f-4824-b30f-f7b9d9526ede service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033756 Nov 28 01:10:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 374/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] [instance: 658d11ca-16ef-48c4-9c87-78b338c5ab2a] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] HTTP exception thrown: Instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a could not be found. Nov 28 01:10:26 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] Returning 404 to user: Instance 658d11ca-16ef-48c4-9c87-78b338c5ab2a could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:10:26 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-7186b5d8-121e-406e-b26c-89559e32914c tempest-VolumesActionsTest-580383771 tempest-VolumesActionsTest-580383771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a" status: 404 len: 111 microversion: 2.1 time: 0.025632 Nov 28 01:10:26 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 366/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:10:26 2023] GET /compute/v2.1/servers/658d11ca-16ef-48c4-9c87-78b338c5ab2a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=10 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=22 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 could not be found. Nov 28 01:10:53 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:10:53 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-7eed4fa2-04c1-4a6c-94b4-55d057c4c163 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180" status: 404 len: 111 microversion: 2.1 time: 0.034340 Nov 28 01:10:53 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 380/1120] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:10:53 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:10:53 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:53 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-82282057-d0c3-41f2-bed2-55ca7aafbaa6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '.version_select at 0x7f4972e6bd90>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-82282057-d0c3-41f2-bed2-55ca7aafbaa6 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999610924" status: 202 len: 0 microversion: 2.1 time: 0.031754 Nov 28 01:10:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 375/1121] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 01:10:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999610924 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 could not be found. Nov 28 01:10:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:10:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-4d1caa8e-4791-4cbf-8324-6bb76fdcc975 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180" status: 404 len: 111 microversion: 2.1 time: 0.032336 Nov 28 01:10:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 367/1122] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:10:58 2023] DELETE /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: 7e025c3f-82f4-4b22-9429-50dd93b3b180] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:10:58 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 could not be found. Nov 28 01:10:58 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance 7e025c3f-82f4-4b22-9429-50dd93b3b180 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:10:58 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-4e7b9abc-65b9-4734-874b-bcf54149b0ab tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180" status: 404 len: 111 microversion: 2.1 time: 0.026086 Nov 28 01:10:58 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 381/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:10:58 2023] GET /compute/v2.1/servers/7e025c3f-82f4-4b22-9429-50dd93b3b180 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be9ab357-37c6-410c-919c-a144d4261ada] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance be9ab357-37c6-410c-919c-a144d4261ada could not be found. Nov 28 01:11:01 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance be9ab357-37c6-410c-919c-a144d4261ada could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:01 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-5fe974f2-1a28-4934-bf3d-95be41db0573 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada" status: 404 len: 111 microversion: 2.1 time: 0.029280 Nov 28 01:11:01 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 376/1124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:11:01 2023] GET /compute/v2.1/servers/be9ab357-37c6-410c-919c-a144d4261ada => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance be77ede0-959e-461b-b138-20828368b597 could not be found. Nov 28 01:11:01 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance be77ede0-959e-461b-b138-20828368b597 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:01 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2876394e-4b51-40b0-80d2-9b79199f22aa tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597" status: 404 len: 111 microversion: 2.1 time: 0.028256 Nov 28 01:11:01 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 368/1125] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:11:01 2023] DELETE /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] [instance: be77ede0-959e-461b-b138-20828368b597] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] HTTP exception thrown: Instance be77ede0-959e-461b-b138-20828368b597 could not be found. Nov 28 01:11:01 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Returning 404 to user: Instance be77ede0-959e-461b-b138-20828368b597 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:01 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f6d473df-359a-4742-8bbd-9f5597a06a6a tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597" status: 404 len: 111 microversion: 2.1 time: 0.024988 Nov 28 01:11:01 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 382/1126] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:11:01 2023] GET /compute/v2.1/servers/be77ede0-959e-461b-b138-20828368b597 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc could not be found. Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-cda8dd59-c871-4296-8c8e-6b2d35ee7c4a tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc" status: 404 len: 111 microversion: 2.1 time: 0.044828 Nov 28 01:11:02 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 377/1127] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:11:02 2023] DELETE /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: a4968288-fce2-45df-8ec1-9fc8b7db41cc] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc could not be found. Nov 28 01:11:02 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance a4968288-fce2-45df-8ec1-9fc8b7db41cc could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:02 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-80f359d2-3ca3-46ec-8fab-6aa2aa5a648e tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc" status: 404 len: 111 microversion: 2.1 time: 0.034844 Nov 28 01:11:02 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 369/1128] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:11:02 2023] GET /compute/v2.1/servers/a4968288-fce2-45df-8ec1-9fc8b7db41cc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:02 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c could not be found. Nov 28 01:11:02 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:02 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ff87cb01-1663-45f4-851a-e7c77ab2e7ff tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" status: 404 len: 111 microversion: 2.1 time: 0.035292 Nov 28 01:11:02 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 383/1129] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:11:02 2023] DELETE /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c could not be found. Nov 28 01:11:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-8f5fbfe1-0101-4cb5-8f23-dd425da4ac66 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c" status: 404 len: 111 microversion: 2.1 time: 0.045362 Nov 28 01:11:02 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 378/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:11:02 2023] GET /compute/v2.1/servers/ae6fe4b1-96e1-44ca-9218-cc0dbd234a1c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-48cbe2eb-683f-4857-a629-d9aaf9cdb438 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] Calling method '.version_select at 0x7f4972d2b400>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-48cbe2eb-683f-4857-a629-d9aaf9cdb438 tempest-TestVolumeBootPattern-1156826038 tempest-TestVolumeBootPattern-1156826038-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-832294225" status: 202 len: 0 microversion: 2.1 time: 0.021924 Nov 28 01:11:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 370/1131] 10.0.0.210 () {62 vars in 1337 bytes} [Tue Nov 28 01:11:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-832294225 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance f0b22014-115e-4871-8dfa-dd14d4c2312e could not be found. Nov 28 01:11:07 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance f0b22014-115e-4871-8dfa-dd14d4c2312e could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:07 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-cf13dd1d-dbbe-46e5-8079-bc26c52aca77 tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e" status: 404 len: 111 microversion: 2.1 time: 0.041379 Nov 28 01:11:07 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 384/1132] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:11:07 2023] DELETE /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] [instance: f0b22014-115e-4871-8dfa-dd14d4c2312e] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:07 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] HTTP exception thrown: Instance f0b22014-115e-4871-8dfa-dd14d4c2312e could not be found. Nov 28 01:11:07 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] Returning 404 to user: Instance f0b22014-115e-4871-8dfa-dd14d4c2312e could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:07 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2e5684c9-6a47-483f-9165-232692ea0dce tempest-AttachVolumeNegativeTest-471615281 tempest-AttachVolumeNegativeTest-471615281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e" status: 404 len: 111 microversion: 2.1 time: 0.032418 Nov 28 01:11:07 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 379/1133] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:11:07 2023] GET /compute/v2.1/servers/f0b22014-115e-4871-8dfa-dd14d4c2312e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] [instance: cb931a0c-8094-497e-a63b-676c763d5f44] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] HTTP exception thrown: Instance cb931a0c-8094-497e-a63b-676c763d5f44 could not be found. Nov 28 01:11:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Returning 404 to user: Instance cb931a0c-8094-497e-a63b-676c763d5f44 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0796ebf0-8372-4401-a290-09688fe7abac tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44" status: 404 len: 111 microversion: 2.1 time: 0.034943 Nov 28 01:11:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 371/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:11:10 2023] GET /compute/v2.1/servers/cb931a0c-8094-497e-a63b-676c763d5f44 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 01:11:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-657f4ab8-136d-4953-bd5b-816b8c79cdf6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] Calling method '.version_select at 0x7f4972fd13f0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-657f4ab8-136d-4953-bd5b-816b8c79cdf6 tempest-ServerStableDeviceRescueTest-109213497 tempest-ServerStableDeviceRescueTest-109213497-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738700815" status: 202 len: 0 microversion: 2.1 time: 0.027098 Nov 28 01:11:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 385/1135] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 01:11:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738700815 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:11:12 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-89af006b-dda8-4f07-b534-2ad5c6257b78 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Action: 'create', calling method: .version_select at 0x7f497350e950>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-391983786", "metadata": {"Type": "work"}}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:11:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-89af006b-dda8-4f07-b534-2ad5c6257b78 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.516025 Nov 28 01:11:13 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 380/1136] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 01:11:12 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 518 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 28 01:11:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f6190fb9-950a-40e4-992a-a58a41627097 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972ee30a0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f6190fb9-950a-40e4-992a-a58a41627097 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 200 len: 352 microversion: 2.1 time: 0.050055 Nov 28 01:11:13 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 372/1137] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:13 2023] GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-967d7970-f37f-49c1-a76b-c9236e74a6d1 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972e54670>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-967d7970-f37f-49c1-a76b-c9236e74a6d1 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 200 len: 352 microversion: 2.1 time: 0.057344 Nov 28 01:11:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 386/1138] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:14 2023] GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:15 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7343582d-fdd5-4fca-b7f8-1a017b206de9 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972ef5480>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:15 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7343582d-fdd5-4fca-b7f8-1a017b206de9 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 200 len: 353 microversion: 2.1 time: 0.130569 Nov 28 01:11:15 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 381/1139] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:15 2023] GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-080c2788-7431-4191-b05c-b9a7038a1c66 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972d81480>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-080c2788-7431-4191-b05c-b9a7038a1c66 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 200 len: 353 microversion: 2.1 time: 0.063272 Nov 28 01:11:15 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 373/1140] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:15 2023] GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-715cdde9-84aa-4e70-90f5-b26f28012933 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972e397e0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-715cdde9-84aa-4e70-90f5-b26f28012933 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 202 len: 0 microversion: 2.1 time: 0.064248 Nov 28 01:11:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 387/1141] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 01:11:15 2023] DELETE /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:11:15 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-6814dc78-3a3b-458e-bd9c-b37ceb86850c tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972f95120>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:15 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-6814dc78-3a3b-458e-bd9c-b37ceb86850c tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 200 len: 352 microversion: 2.1 time: 0.064392 Nov 28 01:11:15 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 382/1142] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:15 2023] GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-2af8fafb-dd56-4200-bf53-03cc4729eac5 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972d82d40>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-2af8fafb-dd56-4200-bf53-03cc4729eac5 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 200 len: 352 microversion: 2.1 time: 0.060919 Nov 28 01:11:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 374/1143] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:16 2023] GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:11:17 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-3a0769a7-741d-4b14-8b9d-6a6234845fe1 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972e3b250>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:17 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-3a0769a7-741d-4b14-8b9d-6a6234845fe1 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 200 len: 352 microversion: 2.1 time: 0.055644 Nov 28 01:11:17 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 388/1144] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:17 2023] GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:18 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:11:18 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:11:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0a49c1cc-d2cc-42ac-bd49-187684edb514 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Calling method '.version_select at 0x7f4972ed36d0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-0a49c1cc-d2cc-42ac-bd49-187684edb514 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] HTTP exception thrown: Volume be21b8f1-3613-4a5d-acb3-5e0d8c9026ff could not be found. Nov 28 01:11:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0a49c1cc-d2cc-42ac-bd49-187684edb514 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] Returning 404 to user: Volume be21b8f1-3613-4a5d-acb3-5e0d8c9026ff could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:11:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0a49c1cc-d2cc-42ac-bd49-187684edb514 tempest-VolumesGetTestJSON-1667448208 tempest-VolumesGetTestJSON-1667448208-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff" status: 404 len: 109 microversion: 2.1 time: 0.048311 Nov 28 01:11:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 383/1145] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:18 2023] GET /compute/v2.1/os-volumes/be21b8f1-3613-4a5d-acb3-5e0d8c9026ff => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:11:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:11:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:11:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8048e3b1-7fec-4cad-aa74-581b4ef22eb7 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972d29bd0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-8048e3b1-7fec-4cad-aa74-581b4ef22eb7 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/026b802c-5c1f-4b99-9ad6-ad0269973c6a" status: 200 len: 350 microversion: 2.1 time: 0.089319 Nov 28 01:11:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 375/1146] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:22 2023] GET /compute/v2.1/os-volumes/026b802c-5c1f-4b99-9ad6-ad0269973c6a => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:28 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=10 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:11:28 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:11:28 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-2cd62360-7eba-429f-abe3-89175fa332e1 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f497357beb0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-2cd62360-7eba-429f-abe3-89175fa332e1 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ec3ecb2f-3c3b-4e41-ae44-ccba78ed3117" status: 200 len: 351 microversion: 2.1 time: 0.090467 Nov 28 01:11:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 389/1147] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:28 2023] GET /compute/v2.1/os-volumes/ec3ecb2f-3c3b-4e41-ae44-ccba78ed3117 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ec87e894-6c39-4f23-850d-a8b0955b5326 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972e69cf0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ec87e894-6c39-4f23-850d-a8b0955b5326 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9a942ed9-3d14-4dcf-b970-5795941c3619" status: 200 len: 350 microversion: 2.1 time: 0.053102 Nov 28 01:11:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 384/1148] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 01:11:34 2023] GET /compute/v2.1/os-volumes/9a942ed9-3d14-4dcf-b970-5795941c3619 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-220b56c6-8502-4bc4-8559-89004eb2ae6b tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972d82b00>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:34 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-220b56c6-8502-4bc4-8559-89004eb2ae6b tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.096447 Nov 28 01:11:34 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 376/1149] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 28 01:11:34 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:11:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-b4bbb302-03c3-41d9-a120-9367b961bf07 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972e3a680>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-b4bbb302-03c3-41d9-a120-9367b961bf07 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.097491 Nov 28 01:11:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 390/1150] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Nov 28 01:11:34 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0bfb2043-f84b-4fac-8349-71fa9dba1a44 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972ef4040>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0bfb2043-f84b-4fac-8349-71fa9dba1a44 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085538 Nov 28 01:11:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 385/1151] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 28 01:11:34 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:11:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b4db6058-f4a9-4aea-8937-9ad32a91068f tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972ee2b00>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b4db6058-f4a9-4aea-8937-9ad32a91068f tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.080044 Nov 28 01:11:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 377/1152] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Nov 28 01:11:35 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-569dbb1c-3f10-42c0-bfcd-3264beb00ff3 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972e54280>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-569dbb1c-3f10-42c0-bfcd-3264beb00ff3 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.079833 Nov 28 01:11:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 391/1153] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Nov 28 01:11:35 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:35 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c83ad10d-d617-4099-909f-16c312f8c772 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972ed1f30>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:35 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c83ad10d-d617-4099-909f-16c312f8c772 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.104489 Nov 28 01:11:35 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 386/1154] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 28 01:11:35 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:11:35 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-fa26d992-9029-4f00-97a0-cf3c3331a482 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972dd0ee0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-fa26d992-9029-4f00-97a0-cf3c3331a482 tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.110915 Nov 28 01:11:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 378/1155] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Nov 28 01:11:35 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-dc611a87-a0dc-449a-b429-1232efef049d tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] Calling method '.version_select at 0x7f4972fd1cf0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-dc611a87-a0dc-449a-b429-1232efef049d tempest-VolumesTestJSON-1064358325 tempest-VolumesTestJSON-1064358325-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097013 Nov 28 01:11:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 392/1156] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 28 01:11:35 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:11:52 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-07d24c54-0cc0-465e-b235-1a409ca0c9fa tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Action: 'create', calling method: .version_select at 0x7f4972ef6170>, body: {"keypair": {"name": "tempest-keypair-1320549272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtYCWCDQuZb4DfC+SU6lFmR3Hw+VfcMeSDfs4mLyV9XIQewuB4DEh/RJDa5md+FZLJ1GtflCF+wZrmEDlinv6wQ8yqc/ZDj6UacHhypFflJEZbSEAc3EGIUaNoHCUqvQ=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:11:52 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-07d24c54-0cc0-465e-b235-1a409ca0c9fa tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting quotas for project dda55c6e8fd645869a7530dcb9910b25. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:11:52 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-07d24c54-0cc0-465e-b235-1a409ca0c9fa tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting quotas for user 90118ca36d3048568d1b1a1992a1408e and project dda55c6e8fd645869a7530dcb9910b25. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:11:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-07d24c54-0cc0-465e-b235-1a409ca0c9fa tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052368 Nov 28 01:11:52 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 387/1157] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:11:52 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-635438247", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "b825e2f0-6d05-4d76-a111-f0deffb0518f"}], "security_groups": [{"name": "tempest-securitygroup--2080537356"}], "key_name": "tempest-keypair-1320549272", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] validate_networks() for [('b825e2f0-6d05-4d76-a111-f0deffb0518f', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting quotas for project dda55c6e8fd645869a7530dcb9910b25. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting quotas for user 90118ca36d3048568d1b1a1992a1408e and project dda55c6e8fd645869a7530dcb9910b25. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:11:54 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:11:54 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0c3d9546-b361-4d7b-8d36-d17dae4e9d16 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.588966 Nov 28 01:11:54 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 379/1158] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:11:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:11:54 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-5da183ae-b7bf-4688-9d44-1a38a53ff054 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:11:54 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-5da183ae-b7bf-4688-9d44-1a38a53ff054 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:11:54 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-5da183ae-b7bf-4688-9d44-1a38a53ff054 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90118ca36d3048568d1b1a1992a1408e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda55c6e8fd645869a7530dcb9910b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:11:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-5da183ae-b7bf-4688-9d44-1a38a53ff054 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b" status: 200 len: 1234 microversion: 2.1 time: 0.074317 Nov 28 01:11:55 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 393/1159] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:11:54 2023] GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b => generated 1234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:11:57 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f08617-1de4-4ad2-8d6a-17a08873037b", "tag": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:11:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:11:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:11:57 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:11:57 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] Creating event network-changed:7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance d4f08617-1de4-4ad2-8d6a-17a08873037b on user Nov 28 01:11:57 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-b7dda21e-e257-4e24-9511-47cef9dc427f req-b404556b-4701-400d-a3e8-4725276110d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035656 Nov 28 01:11:57 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 388/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:11:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:12:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f08617-1de4-4ad2-8d6a-17a08873037b", "name": "network-vif-plugged", "status": "completed", "tag": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:12:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:12:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:12:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:12:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] Creating event network-vif-plugged:7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance d4f08617-1de4-4ad2-8d6a-17a08873037b on user Nov 28 01:12:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-955d2d08-9fa6-4375-b474-373f3cd1c082 req-f6162e93-ed2d-4198-b3f0-44c61a970cbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035791 Nov 28 01:12:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 380/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:12:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:12:02 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f08617-1de4-4ad2-8d6a-17a08873037b", "name": "network-vif-plugged", "status": "completed", "tag": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:12:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:12:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:12:02 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:12:02 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] Creating event network-vif-plugged:7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance d4f08617-1de4-4ad2-8d6a-17a08873037b on user Nov 28 01:12:02 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-3e553f4a-e619-4152-80e2-2742af69d52b req-081a450f-88ea-488e-941d-552fae27fa8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041762 Nov 28 01:12:02 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 394/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:12:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:12:45 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:12:45 user devstack@n-api.service[65277]: Tue Nov 28 01:12:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b (ip 10.0.0.210) !!! Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:12:45 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90118ca36d3048568d1b1a1992a1408e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda55c6e8fd645869a7530dcb9910b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:12:45 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-3e11318c-49d1-4ff6-b084-6204ff3da490 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b" status: 200 len: 1544 microversion: 2.1 time: 0.398450 Nov 28 01:12:45 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 389/1163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:12:45 2023] GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b => generated 1544 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:13:45 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:13:45 user devstack@n-api.service[65276]: Tue Nov 28 01:13:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b/os-interface (ip 10.0.0.210) !!! Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:45 user devstack@n-api.service[65276]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6133721-5edc-44fc-97a9-e940e29d4b64] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:13:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:13:45 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-3d1e2a45-3772-4d5d-8a1c-d2b4688135df tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.321777 Nov 28 01:13:45 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 381/1164] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:13:45 2023] GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b/os-interface => generated 283 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:13:46 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:46 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:46 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:46 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f08617-1de4-4ad2-8d6a-17a08873037b", "tag": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:13:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:13:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:13:46 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:13:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] Creating event network-changed:7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance d4f08617-1de4-4ad2-8d6a-17a08873037b on user Nov 28 01:13:46 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-ff46ffa5-e11e-4910-abc7-af1c37815a68 req-1b7589f2-0943-4df9-9bc6-fa3e79415868 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046739 Nov 28 01:13:46 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 395/1165] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:13:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30325890-7723-4d78-b751-247876109c62", "device": "/dev/vdb"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:13:46 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:13:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-72ea4f32-8115-47ec-bce9-b46f3e5cdaf8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397280 Nov 28 01:13:47 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 390/1166] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:13:46 2023] POST /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:13:53 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-dc7e94f9-fbcd-4861-9bd4-e34b69ab5c26 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Action: 'create', calling method: .version_select at 0x7f4972dd04c0>, body: {"keypair": {"name": "tempest-keypair-449884608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyXFae5/hSKsUVk3ewdKKtsMGo31X5jvAUtG8xeOxMo40Qn7+oGIOR+89UCaISVyd5JDnlFxBVQ5RTQxG72sdQzKyXZhqjU/jef0RGyN1TrhGmJ9z7G9rknduVbN1Inog=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:13:53 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6133721-5edc-44fc-97a9-e940e29d4b64] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 54204. Nov 28 01:13:53 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-dc7e94f9-fbcd-4861-9bd4-e34b69ab5c26 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Getting quotas for project 77e203bb29f74a8e8ef0b75bedbdbec3. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:13:53 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-dc7e94f9-fbcd-4861-9bd4-e34b69ab5c26 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Getting quotas for user cef1d744ac594ab4a32a7355ddff4b8b and project 77e203bb29f74a8e8ef0b75bedbdbec3. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:13:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-dc7e94f9-fbcd-4861-9bd4-e34b69ab5c26 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058952 Nov 28 01:13:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 382/1167] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:13:53 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:13:54 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachmentScenario-server-2085450450", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "20ad1c0d-5631-4468-8686-4ff9af7eb6ec"}], "security_groups": [{"name": "tempest-securitygroup--1349469959"}], "key_name": "tempest-keypair-449884608", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] validate_networks() for [('20ad1c0d-5631-4468-8686-4ff9af7eb6ec', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Getting quotas for project 77e203bb29f74a8e8ef0b75bedbdbec3. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Getting quotas for user cef1d744ac594ab4a32a7355ddff4b8b and project 77e203bb29f74a8e8ef0b75bedbdbec3. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:13:55 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:13:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-cd842a5e-9446-4a86-971e-4d6734f69c62 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.872063 Nov 28 01:13:55 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 396/1168] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:13:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:13:55 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e136321f-d98f-4cd2-9d04-bfe31b5fa533 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:13:55 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e136321f-d98f-4cd2-9d04-bfe31b5fa533 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:13:55 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-e136321f-d98f-4cd2-9d04-bfe31b5fa533 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef1d744ac594ab4a32a7355ddff4b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e203bb29f74a8e8ef0b75bedbdbec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:13:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e136321f-d98f-4cd2-9d04-bfe31b5fa533 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69" status: 200 len: 1243 microversion: 2.1 time: 0.074992 Nov 28 01:13:55 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 391/1169] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:13:55 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69 => generated 1243 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:13:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:13:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8104f3b0-49a7-4036-8ff6-56594ce3ee69", "tag": "10103dcb-bcfe-4b53-8292-b97019bca924"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:13:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:13:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:13:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:13:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] Creating event network-changed:10103dcb-bcfe-4b53-8292-b97019bca924 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 on user Nov 28 01:13:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-8be3c99a-66b9-4750-82af-51cd666c2a6b req-1ff5edd0-f5a9-410f-9053-c92202d5b02f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091394 Nov 28 01:13:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 383/1170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:13:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:14:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8104f3b0-49a7-4036-8ff6-56594ce3ee69", "name": "network-vif-plugged", "status": "completed", "tag": "10103dcb-bcfe-4b53-8292-b97019bca924"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:14:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] Creating event network-vif-plugged:10103dcb-bcfe-4b53-8292-b97019bca924 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 on user Nov 28 01:14:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-69de0a38-63ec-45ea-85e2-028bd90c77a2 req-839fe09d-0214-456a-90ec-f1c480d24fa9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136637 Nov 28 01:14:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 397/1171] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:14:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:14:02 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8104f3b0-49a7-4036-8ff6-56594ce3ee69", "name": "network-vif-plugged", "status": "completed", "tag": "10103dcb-bcfe-4b53-8292-b97019bca924"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:14:02 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:02 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] Creating event network-vif-plugged:10103dcb-bcfe-4b53-8292-b97019bca924 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 on user Nov 28 01:14:02 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-ef63442e-f3e5-47a4-8887-2784c4609adc req-d5759194-4b61-4f38-8166-57778702ccca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034688 Nov 28 01:14:02 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 392/1172] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:14:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:16 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'services' on Instance uuid d4f08617-1de4-4ad2-8d6a-17a08873037b {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:14:16 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-fe05eec9-8065-48d1-a404-c9e87ae81fa7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b/os-volume_attachments/30325890-7723-4d78-b751-247876109c62" status: 202 len: 0 microversion: 2.1 time: 0.180241 Nov 28 01:14:16 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 384/1173] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:14:16 2023] DELETE /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b/os-volume_attachments/30325890-7723-4d78-b751-247876109c62 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:16 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:14:16 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-128d5d24-1320-41ca-b97f-83359f8049b8 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b" status: 204 len: 0 microversion: 2.1 time: 0.126443 Nov 28 01:14:16 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 398/1174] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:14:16 2023] DELETE /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:16 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90118ca36d3048568d1b1a1992a1408e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda55c6e8fd645869a7530dcb9910b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:14:16 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e76a35e3-7a46-4775-86fc-48da17df4483 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b" status: 200 len: 1714 microversion: 2.1 time: 0.210593 Nov 28 01:14:16 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 393/1175] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:14:16 2023] GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b => generated 1714 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:14:38 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 28 01:14:38 user devstack@n-api.service[65276]: Tue Nov 28 01:14:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 01:14:38 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:38 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:38 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f08617-1de4-4ad2-8d6a-17a08873037b", "name": "network-vif-unplugged", "status": "completed", "tag": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:14:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] Creating event network-vif-unplugged:7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance d4f08617-1de4-4ad2-8d6a-17a08873037b on user Nov 28 01:14:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-74836f66-a2e1-486b-a4c4-54602521311d req-59a38d23-1583-4d87-a72a-e0d077fb5828 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039561 Nov 28 01:14:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 385/1176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:14:39 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-ae246afa-ad3f-43b9-bc4d-c319fb1590aa req-e9ab23e4-692a-4388-be6a-c926c2b1d2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f08617-1de4-4ad2-8d6a-17a08873037b", "name": "network-vif-deleted", "tag": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:14:39 user devstack@n-api.service[65278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c5d6a7e-3d80-483e-ae8a-f0653bba0fb1] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 01:14:39 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:39 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ae246afa-ad3f-43b9-bc4d-c319fb1590aa req-e9ab23e4-692a-4388-be6a-c926c2b1d2e2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ae246afa-ad3f-43b9-bc4d-c319fb1590aa req-e9ab23e4-692a-4388-be6a-c926c2b1d2e2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-ae246afa-ad3f-43b9-bc4d-c319fb1590aa req-e9ab23e4-692a-4388-be6a-c926c2b1d2e2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-ae246afa-ad3f-43b9-bc4d-c319fb1590aa req-e9ab23e4-692a-4388-be6a-c926c2b1d2e2 service nova] Creating event network-vif-deleted:7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance d4f08617-1de4-4ad2-8d6a-17a08873037b on user Nov 28 01:14:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-ae246afa-ad3f-43b9-bc4d-c319fb1590aa req-e9ab23e4-692a-4388-be6a-c926c2b1d2e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044008 Nov 28 01:14:39 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 399/1177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:14:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:14:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f08617-1de4-4ad2-8d6a-17a08873037b", "name": "network-vif-plugged", "status": "completed", "tag": "7bbf53e5-9795-4a4c-8a4b-3dfb0807845a"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:14:40 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:40 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:14:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] Creating event network-vif-plugged:7bbf53e5-9795-4a4c-8a4b-3dfb0807845a for instance d4f08617-1de4-4ad2-8d6a-17a08873037b on user Nov 28 01:14:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0e76d37c-c712-4096-9b25-942b06c5f08e req-19408248-657a-4f7e-83b4-2ee7df7ef71b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036495 Nov 28 01:14:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 394/1178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:14:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:14:45 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:14:45 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:14:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:14:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:14:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:14:46 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef1d744ac594ab4a32a7355ddff4b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e203bb29f74a8e8ef0b75bedbdbec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:14:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-ff31390c-a2a3-4482-81ff-21bd4e3e2881 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69" status: 200 len: 1563 microversion: 2.1 time: 0.202894 Nov 28 01:14:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 386/1179] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:14:45 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69 => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: d4f08617-1de4-4ad2-8d6a-17a08873037b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:06 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] [5c5d6a7e-3d80-483e-ae8a-f0653bba0fb1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42812. Nov 28 01:15:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] HTTP exception thrown: Instance d4f08617-1de4-4ad2-8d6a-17a08873037b could not be found. Nov 28 01:15:06 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Returning 404 to user: Instance d4f08617-1de4-4ad2-8d6a-17a08873037b could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:15:06 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-13e63fb7-2e51-4d7d-9bce-dbcb12347316 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b" status: 404 len: 111 microversion: 2.1 time: 0.039572 Nov 28 01:15:06 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 400/1180] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:15:06 2023] GET /compute/v2.1/servers/d4f08617-1de4-4ad2-8d6a-17a08873037b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:15:06 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-04d04b9a-8221-484a-b822-cbe268999edc tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '.version_select at 0x7f49732bfe20>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:06 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:06 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:07 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-04d04b9a-8221-484a-b822-cbe268999edc tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320549272" status: 202 len: 0 microversion: 2.1 time: 0.030960 Nov 28 01:15:07 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 395/1181] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 01:15:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320549272 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:15:21 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-fce71b00-8304-402e-b791-3edc3d9a56f6 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Action: 'create', calling method: .version_select at 0x7f4972d82d40>, body: {"keypair": {"name": "tempest-keypair-2005613057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpj2ahpkdCQ15cwkZMGch7JSD/r+/zmDjn1oN/gdKB8QXyI/CtT+qDM4lvGU4UDdbgh1DCRIdfmtyUre1w1/T79WC4lZzfzqtiICT8xSNmO6QPGEZ+eyUMa2FSy/6VZyQ=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:15:21 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:21 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:21 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-fce71b00-8304-402e-b791-3edc3d9a56f6 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting quotas for project dda55c6e8fd645869a7530dcb9910b25. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:15:21 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-fce71b00-8304-402e-b791-3edc3d9a56f6 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting quotas for user 90118ca36d3048568d1b1a1992a1408e and project dda55c6e8fd645869a7530dcb9910b25. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:15:21 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-fce71b00-8304-402e-b791-3edc3d9a56f6 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055952 Nov 28 01:15:21 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 387/1182] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:15:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:15:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-119539314", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "networks": [{"uuid": "b825e2f0-6d05-4d76-a111-f0deffb0518f"}], "security_groups": [{"name": "tempest-securitygroup--142141177"}], "key_name": "tempest-keypair-2005613057", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:15:22 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:22 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:22 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] validate_networks() for [('b825e2f0-6d05-4d76-a111-f0deffb0518f', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting quotas for project dda55c6e8fd645869a7530dcb9910b25. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Getting quotas for user 90118ca36d3048568d1b1a1992a1408e and project dda55c6e8fd645869a7530dcb9910b25. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:15:23 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:15:23 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a80983c9-c4a3-4e59-a1ba-7d2ee98e34b7 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.568634 Nov 28 01:15:23 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 401/1183] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:15:22 2023] POST /compute/v2.1/servers => generated 403 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:15:23 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:23 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-2355a5e7-7387-4fba-940e-e847f0b53d71 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:23 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-2355a5e7-7387-4fba-940e-e847f0b53d71 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:23 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-2355a5e7-7387-4fba-940e-e847f0b53d71 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90118ca36d3048568d1b1a1992a1408e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda55c6e8fd645869a7530dcb9910b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:15:23 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-2355a5e7-7387-4fba-940e-e847f0b53d71 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07" status: 200 len: 1234 microversion: 2.1 time: 0.079627 Nov 28 01:15:23 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 396/1184] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:15:23 2023] GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07 => generated 1234 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:15:25 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b6bc44-64e6-4137-9046-4440e8274e07", "tag": "f710a167-ab3b-4a35-8cf0-406177b5dc4d"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:15:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] Creating event network-changed:f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance 07b6bc44-64e6-4137-9046-4440e8274e07 on user Nov 28 01:15:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-eea82bc7-01fc-407d-8beb-7870ab3ccf2d req-f58a7488-f32c-472b-a14d-691a166a77a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029938 Nov 28 01:15:25 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 388/1185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:15:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:15:27 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b6bc44-64e6-4137-9046-4440e8274e07", "name": "network-vif-plugged", "status": "completed", "tag": "f710a167-ab3b-4a35-8cf0-406177b5dc4d"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:15:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:27 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:27 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] Creating event network-vif-plugged:f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance 07b6bc44-64e6-4137-9046-4440e8274e07 on user Nov 28 01:15:27 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-6718177c-c251-4999-8f4d-dbe2011165ef req-3787f36d-9b6c-47a3-86ed-b2626b0c4985 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064553 Nov 28 01:15:27 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 402/1186] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:15:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:15:29 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b6bc44-64e6-4137-9046-4440e8274e07", "name": "network-vif-plugged", "status": "completed", "tag": "f710a167-ab3b-4a35-8cf0-406177b5dc4d"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:15:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:29 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] Creating event network-vif-plugged:f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance 07b6bc44-64e6-4137-9046-4440e8274e07 on user Nov 28 01:15:29 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-f3a0237d-6d36-4b87-8a74-4f0964f55e7b req-fc0a652b-5583-4b30-9cc8-d5349ffdd32b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032018 Nov 28 01:15:29 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 397/1187] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:15:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-76bafd28-1ff8-48e4-a3cd-f074cdae82ba tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.148041 Nov 28 01:15:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 389/1188] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:15:46 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-interface => generated 282 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8104f3b0-49a7-4036-8ff6-56594ce3ee69", "tag": "10103dcb-bcfe-4b53-8292-b97019bca924"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:47 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] Creating event network-changed:10103dcb-bcfe-4b53-8292-b97019bca924 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 on user Nov 28 01:15:47 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-9f1a398a-86c0-4f6e-ad25-16ff7225a6df req-2d0da7b4-5d09-4159-bde7-15919d7ca2cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096239 Nov 28 01:15:47 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 403/1189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:15:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:47 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef1d744ac594ab4a32a7355ddff4b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e203bb29f74a8e8ef0b75bedbdbec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:15:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-0261a034-2d2b-4666-a890-512a0ecf5737 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69" status: 200 len: 1563 microversion: 2.1 time: 0.250969 Nov 28 01:15:47 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 398/1190] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:15:47 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cef1d744ac594ab4a32a7355ddff4b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e203bb29f74a8e8ef0b75bedbdbec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Searching by: {'deleted': False, 'project_id': '77e203bb29f74a8e8ef0b75bedbdbec3'} {{(pid=65276) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:47 user devstack@n-api.service[65276]: DEBUG nova.compute.multi_cell_list [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65276) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 01:15:47 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-5d21169a-be22-436a-a761-79bbfe6930a0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 351 microversion: 2.1 time: 0.078178 Nov 28 01:15:47 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 390/1191] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 01:15:47 2023] GET /compute/v2.1/servers => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6b45b4f-d69c-4017-bba8-60618133ff2c"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:48 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-c8514dfe-5b71-4644-a37b-45097228956d tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459628 Nov 28 01:15:48 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 404/1192] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:15:47 2023] POST /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG nova.compute.api [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:58 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:58 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-d8566293-4e67-4826-b736-4d270a6dc07c req-092114de-75c3-4c75-b6f9-90e1e56fb4f1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c" status: 200 len: 302 microversion: 2.89 time: 0.102861 Nov 28 01:15:58 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 399/1193] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 01:15:58 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c => generated 302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=12 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG nova.compute.api [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:58 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:58 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-864b9c96-68c3-46a7-a3ce-4297b9060827 req-5fb5de42-bcbd-46fa-a91d-68872b23c4f8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c" status: 200 len: 302 microversion: 2.89 time: 0.092490 Nov 28 01:15:58 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 391/1194] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 01:15:58 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c => generated 302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG nova.compute.api [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:59 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-40fef455-59c3-4031-9cbd-7cd62c7af9a2 req-b54f5280-c0ec-4597-966e-815840f9ecf5 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c" status: 200 len: 302 microversion: 2.89 time: 0.088915 Nov 28 01:15:59 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 405/1195] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 01:15:59 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c => generated 302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:15:59 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:59 user devstack@n-api.service[65277]: DEBUG nova.compute.api [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:59 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-7404f1d4-b3cd-4707-a9bf-d57768ea015a req-e6912984-8320-458f-a4e5-c4bebbfecd59 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c" status: 200 len: 302 microversion: 2.89 time: 0.094494 Nov 28 01:15:59 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 400/1196] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 01:15:59 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c => generated 302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:15:59 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:15:59 user devstack@n-api.service[65276]: DEBUG nova.compute.api [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:15:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:15:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:15:59 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:15:59 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-018da05e-6744-4ba2-8386-83004eaad76d req-aeb3da2a-d764-43e0-ba1a-a03fb5350ebf tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c" status: 200 len: 302 microversion: 2.89 time: 0.084986 Nov 28 01:15:59 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 392/1197] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 01:15:59 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c => generated 302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:16:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:16:00 user devstack@n-api.service[65278]: DEBUG nova.compute.api [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:16:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-7897d05e-c323-4783-a1dd-992f1c97964c req-2f4aed25-d333-4994-8d2f-c93bd5c4511b tempest-TestServerVolumeAttachmentScenario-2094599272 tempest-TestServerVolumeAttachmentScenario-2094599272-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c" status: 200 len: 302 microversion: 2.89 time: 0.092712 Nov 28 01:16:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 406/1198] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 01:15:59 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c => generated 302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 01:16:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca52e32c-89b6-4397-ba77-916568ea2228"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:16:00 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:16:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-52620346-cf4a-4635-bbf0-08a16d9979d8 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295081 Nov 28 01:16:00 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 401/1199] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:16:00 2023] POST /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=12 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:10 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'services' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:16:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-724334c1-7e5a-47aa-895f-ec4a19d69e2c tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/ca52e32c-89b6-4397-ba77-916568ea2228" status: 202 len: 0 microversion: 2.1 time: 0.158894 Nov 28 01:16:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 393/1200] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:16:10 2023] DELETE /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/ca52e32c-89b6-4397-ba77-916568ea2228 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=12 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:10 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:10 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-628d8425-a772-45de-9e00-4814342cad4e tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048015 Nov 28 01:16:10 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 407/1201] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:16:10 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:16:13 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90118ca36d3048568d1b1a1992a1408e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda55c6e8fd645869a7530dcb9910b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:16:13 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-ee6259a1-3fdd-411d-847f-ea3b0c6d60ca tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07" status: 200 len: 1542 microversion: 2.1 time: 0.215550 Nov 28 01:16:13 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 402/1202] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:16:13 2023] GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07 => generated 1542 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:00 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:00 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-75d25d9c-7c52-4a5d-8065-b47a5088e2f4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051999 Nov 28 01:17:00 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 394/1203] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:17:00 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:00 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lazy-loading 'services' on Instance uuid 8104f3b0-49a7-4036-8ff6-56594ce3ee69 {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:17:00 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-935ce93b-e240-432f-ab84-8c26abea53f0 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c" status: 202 len: 0 microversion: 2.1 time: 0.168631 Nov 28 01:17:00 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 408/1204] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:17:00 2023] DELETE /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:00 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:00 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-aabc9e6c-05d5-41ee-b052-ecfc13a516e1 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055848 Nov 28 01:17:00 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 403/1205] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:17:00 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:13 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e50b0583-6389-4bb9-8970-ac2c1690f7d3 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.193723 Nov 28 01:17:13 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 395/1206] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:17:13 2023] GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07/os-interface => generated 282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:17:14 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:14 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:14 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b6bc44-64e6-4137-9046-4440e8274e07", "tag": "f710a167-ab3b-4a35-8cf0-406177b5dc4d"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:17:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:14 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] Creating event network-changed:f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance 07b6bc44-64e6-4137-9046-4440e8274e07 on user Nov 28 01:17:14 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-c6156eb1-3dcc-4f4c-a74d-6638bdf2ce4a req-1cbf108b-256b-4674-a015-dccef5a3db5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037833 Nov 28 01:17:14 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 409/1207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:17:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9df0213b-c844-4e5c-a2d3-eac2005b2178", "device": "/dev/vdb"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:14 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:14 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7c3ebb71-8569-4788-a50e-1ee1f6c2646c tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "POST /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333967 Nov 28 01:17:14 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 404/1208] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:17:14 2023] POST /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:41 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lazy-loading 'services' on Instance uuid 07b6bc44-64e6-4137-9046-4440e8274e07 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:17:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-53732275-8a70-4e46-a1f4-da9675291448 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07/os-volume_attachments/9df0213b-c844-4e5c-a2d3-eac2005b2178" status: 202 len: 0 microversion: 2.1 time: 0.168609 Nov 28 01:17:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 396/1209] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:17:41 2023] DELETE /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07/os-volume_attachments/9df0213b-c844-4e5c-a2d3-eac2005b2178 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:41 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:17:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-2e51c4ad-2074-4cd5-9e9e-5cf0ba423698 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07" status: 204 len: 0 microversion: 2.1 time: 0.112615 Nov 28 01:17:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 410/1210] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:17:41 2023] DELETE /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:41 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90118ca36d3048568d1b1a1992a1408e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda55c6e8fd645869a7530dcb9910b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:17:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1812c339-6ddf-4cce-b666-6da914a44f0b tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07" status: 200 len: 1712 microversion: 2.1 time: 0.346443 Nov 28 01:17:41 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 405/1211] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:17:41 2023] GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07 => generated 1712 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-fd413df0-ffde-4e68-8ebc-a312f633bcf4 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043623 Nov 28 01:17:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 397/1212] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:17:51 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] HTTP exception thrown: Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 is not attached to volume e6b45b4f-d69c-4017-bba8-60618133ff2c Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Returning 404 to user: Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 is not attached to volume e6b45b4f-d69c-4017-bba8-60618133ff2c {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:17:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-05b4b0b2-16fa-462e-89f4-ffe4abbf3735 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c" status: 404 len: 154 microversion: 2.1 time: 0.084248 Nov 28 01:17:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 411/1213] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:17:51 2023] DELETE /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69/os-volume_attachments/e6b45b4f-d69c-4017-bba8-60618133ff2c => generated 154 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Going to try to terminate instance {{(pid=65277) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:17:51 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-95783561-9e0a-454b-99c0-153db67c0480 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69" status: 204 len: 0 microversion: 2.1 time: 0.121206 Nov 28 01:17:51 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 406/1214] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:17:51 2023] DELETE /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef1d744ac594ab4a32a7355ddff4b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e203bb29f74a8e8ef0b75bedbdbec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:17:51 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-66dc62ab-4cbc-4fcb-aa31-3db0bd658f8b tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69" status: 200 len: 1688 microversion: 2.1 time: 0.223480 Nov 28 01:17:51 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 398/1215] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:17:51 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69 => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8104f3b0-49a7-4036-8ff6-56594ce3ee69", "name": "network-vif-unplugged", "status": "completed", "tag": "10103dcb-bcfe-4b53-8292-b97019bca924"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:51 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] Creating event network-vif-unplugged:10103dcb-bcfe-4b53-8292-b97019bca924 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 on user Nov 28 01:17:51 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-653c6309-3195-4e32-9178-83349158ba21 req-e4ca908e-b5e6-4bac-b305-ca205addcfda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030562 Nov 28 01:17:51 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 412/1216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:17:52 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-b2208140-af69-4253-a66f-9f91d82be8a5 req-cc37a133-8deb-494e-af2c-4ccdcfa89435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8104f3b0-49a7-4036-8ff6-56594ce3ee69", "name": "network-vif-deleted", "tag": "10103dcb-bcfe-4b53-8292-b97019bca924"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:17:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b2208140-af69-4253-a66f-9f91d82be8a5 req-cc37a133-8deb-494e-af2c-4ccdcfa89435 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b2208140-af69-4253-a66f-9f91d82be8a5 req-cc37a133-8deb-494e-af2c-4ccdcfa89435 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:52 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b2208140-af69-4253-a66f-9f91d82be8a5 req-cc37a133-8deb-494e-af2c-4ccdcfa89435 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b2208140-af69-4253-a66f-9f91d82be8a5 req-cc37a133-8deb-494e-af2c-4ccdcfa89435 service nova] Creating event network-vif-deleted:10103dcb-bcfe-4b53-8292-b97019bca924 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 on user Nov 28 01:17:52 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-b2208140-af69-4253-a66f-9f91d82be8a5 req-cc37a133-8deb-494e-af2c-4ccdcfa89435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052152 Nov 28 01:17:52 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 407/1217] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:17:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:17:53 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8104f3b0-49a7-4036-8ff6-56594ce3ee69", "name": "network-vif-plugged", "status": "completed", "tag": "10103dcb-bcfe-4b53-8292-b97019bca924"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:17:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:17:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:17:53 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:17:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] Creating event network-vif-plugged:10103dcb-bcfe-4b53-8292-b97019bca924 for instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 on user Nov 28 01:17:53 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-9337edbc-37aa-40d0-8357-3253262f802c req-1f36faec-d283-4be1-bd34-cb41b17349c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029626 Nov 28 01:17:53 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 399/1218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:17:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:18:03 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:03 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:03 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b6bc44-64e6-4137-9046-4440e8274e07", "name": "network-vif-unplugged", "status": "completed", "tag": "f710a167-ab3b-4a35-8cf0-406177b5dc4d"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:18:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:18:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:18:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:18:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] Creating event network-vif-unplugged:f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance 07b6bc44-64e6-4137-9046-4440e8274e07 on user Nov 28 01:18:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-26cd20ee-def5-468d-a2e1-8b1273c66c5f req-6b964483-f57a-4eaf-9ef9-12021cfa7e1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039474 Nov 28 01:18:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 413/1219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:18:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:18:04 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:04 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:04 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-5d8f7421-b163-4c76-9e39-78e887ce15c0 req-675c6ec3-4d1c-40eb-9bd2-0e803b085e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b6bc44-64e6-4137-9046-4440e8274e07", "name": "network-vif-deleted", "tag": "f710a167-ab3b-4a35-8cf0-406177b5dc4d"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:18:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5d8f7421-b163-4c76-9e39-78e887ce15c0 req-675c6ec3-4d1c-40eb-9bd2-0e803b085e40 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:18:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5d8f7421-b163-4c76-9e39-78e887ce15c0 req-675c6ec3-4d1c-40eb-9bd2-0e803b085e40 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:18:04 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-5d8f7421-b163-4c76-9e39-78e887ce15c0 req-675c6ec3-4d1c-40eb-9bd2-0e803b085e40 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:18:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-5d8f7421-b163-4c76-9e39-78e887ce15c0 req-675c6ec3-4d1c-40eb-9bd2-0e803b085e40 service nova] Creating event network-vif-deleted:f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance 07b6bc44-64e6-4137-9046-4440e8274e07 on user Nov 28 01:18:04 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-5d8f7421-b163-4c76-9e39-78e887ce15c0 req-675c6ec3-4d1c-40eb-9bd2-0e803b085e40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046021 Nov 28 01:18:04 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 408/1220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:18:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:18:05 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b6bc44-64e6-4137-9046-4440e8274e07", "name": "network-vif-plugged", "status": "completed", "tag": "f710a167-ab3b-4a35-8cf0-406177b5dc4d"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:18:05 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:05 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:18:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:18:05 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:18:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] Creating event network-vif-plugged:f710a167-ab3b-4a35-8cf0-406177b5dc4d for instance 07b6bc44-64e6-4137-9046-4440e8274e07 on user Nov 28 01:18:05 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ac25cf40-9608-4eff-9b6d-5ec76c5a5207 req-3ae51ad7-3c7a-4744-af8f-287f4b31333a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043149 Nov 28 01:18:05 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 400/1221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:18:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] [instance: 07b6bc44-64e6-4137-9046-4440e8274e07] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:18:31 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] HTTP exception thrown: Instance 07b6bc44-64e6-4137-9046-4440e8274e07 could not be found. Nov 28 01:18:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Returning 404 to user: Instance 07b6bc44-64e6-4137-9046-4440e8274e07 could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:18:31 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-42c96472-b021-4f7e-b011-fab867cfa006 tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07" status: 404 len: 111 microversion: 2.1 time: 0.035088 Nov 28 01:18:31 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 414/1222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:18:31 2023] GET /compute/v2.1/servers/07b6bc44-64e6-4137-9046-4440e8274e07 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:18:31 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:31 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:31 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-44d50b45-b044-4687-8f27-93c191c1a7cb tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] Calling method '.version_select at 0x7f4972ef72e0>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:18:31 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-44d50b45-b044-4687-8f27-93c191c1a7cb tempest-VolumesSnapshotTestJSON-1830776622 tempest-VolumesSnapshotTestJSON-1830776622-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2005613057" status: 202 len: 0 microversion: 2.1 time: 0.033407 Nov 28 01:18:31 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 409/1223] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 01:18:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2005613057 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] [instance: 8104f3b0-49a7-4036-8ff6-56594ce3ee69] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:18:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.wsgi [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] HTTP exception thrown: Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 could not be found. Nov 28 01:18:41 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Returning 404 to user: Instance 8104f3b0-49a7-4036-8ff6-56594ce3ee69 could not be found. {{(pid=65276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:18:41 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-7dee40bc-3409-4ad8-817f-98711b8713cd tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69" status: 404 len: 111 microversion: 2.1 time: 0.049833 Nov 28 01:18:41 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 401/1224] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:18:41 2023] GET /compute/v2.1/servers/8104f3b0-49a7-4036-8ff6-56594ce3ee69 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:18:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ae40a00f-3027-4bd7-b078-a889edb04c37 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] Calling method '.version_select at 0x7f4972e565f0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:18:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ae40a00f-3027-4bd7-b078-a889edb04c37 tempest-TestServerVolumeAttachmentScenario-784605151 tempest-TestServerVolumeAttachmentScenario-784605151-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-449884608" status: 202 len: 0 microversion: 2.1 time: 0.026115 Nov 28 01:18:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 415/1225] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 01:18:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-449884608 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:19:30 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:19:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-7edfc50e-1f81-47bc-90c6-d33c7024b617 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'create', calling method: .version_select at 0x7f4973089b40>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-118115395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhFeIp+4t0q4hFYIuD10TofaQEGB5FUolurYENm1AaB8PxZ5AowLMxK66Fk+wegDnLyiBXDXSFeAN2OWQBSQyIcvTmcSlskh9EU9LhMsHS5h7Yl4U7ZtZhQZ56dJv9Yrg=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:19:31 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-7edfc50e-1f81-47bc-90c6-d33c7024b617 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting quotas for project b60fd2418cf34127830ceed618456a71. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:19:31 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-7edfc50e-1f81-47bc-90c6-d33c7024b617 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting quotas for user 9840cdc8142e46199dd32a7ea108ea4a and project b60fd2418cf34127830ceed618456a71. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:19:31 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-7edfc50e-1f81-47bc-90c6-d33c7024b617 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060987 Nov 28 01:19:31 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 410/1226] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:19:30 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1980639582", "imageRef": "5134e6f4-67bb-4398-9322-d26991a40a07", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-118115395", "networks": [{"uuid": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd"}]}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.network.neutron [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] validate_networks() for [('8c0c53ac-6841-49ed-9cab-9b350f8fecbd', None, None, None, None, None)] {{(pid=65276) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image limits 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image pref 0:0:0 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.virt.hardware [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting quotas for project b60fd2418cf34127830ceed618456a71. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting quotas for user 9840cdc8142e46199dd32a7ea108ea4a and project b60fd2418cf34127830ceed618456a71. Resources: {'cores', 'instances', 'ram'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Going to run 1 instances... {{(pid=65276) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:19:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5134e6f4-67bb-4398-9322-d26991a40a07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:19:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-09f03a1b-4029-4793-afed-f51a968bc0cd tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.701161 Nov 28 01:19:31 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 402/1227] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:19:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:19:31 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:19:31 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:19:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-d4e8aaae-434f-433d-85fd-5e68d10969bf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:19:31 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-d4e8aaae-434f-433d-85fd-5e68d10969bf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:19:31 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-d4e8aaae-434f-433d-85fd-5e68d10969bf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:19:31 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-d4e8aaae-434f-433d-85fd-5e68d10969bf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1250 microversion: 2.1 time: 0.121234 Nov 28 01:19:31 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 416/1228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:19:31 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1250 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:19:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:19:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:19:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:19:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:19:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] Creating event network-changed:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:19:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-0812ad44-cbe8-4d5b-8041-1a7054b08b71 req-3d9d89fd-eff9-4a11-8d95-e47216cb4dcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093863 Nov 28 01:19:34 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 411/1229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:19:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:19:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:19:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:19:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:19:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:19:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:19:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-e8b4771a-6a92-4c86-81b8-14367923aef9 req-d3de364f-9f8f-4d24-8060-741e74a8f7c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057959 Nov 28 01:19:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 403/1230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:19:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:19:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:19:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:19:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:19:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:19:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:19:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-2174b88e-82c8-48fa-803b-6b9112366f48 req-f3a948ab-4915-4cc8-ae18-782b4fce569c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Nov 28 01:19:38 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 417/1231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:20:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:20:22 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:20:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-358cfdbd-60fc-43f8-8ca8-fe5497d6f56e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1534 microversion: 2.1 time: 0.269550 Nov 28 01:20:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 412/1232] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:20:21 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1534 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:21:22 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:21:22 user devstack@n-api.service[65276]: Tue Nov 28 01:21:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b (ip 10.0.0.210) !!! Nov 28 01:21:22 user devstack@n-api.service[65276]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6133721-5edc-44fc-97a9-e940e29d4b64] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:22 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:21:22 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-7e516e71-ab33-4d21-a4b5-769c8c75cfd0 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1534 microversion: 2.1 time: 0.227447 Nov 28 01:21:22 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 404/1233] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:21:22 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1534 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:21:22 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:21:22 user devstack@n-api.service[65278]: Tue Nov 28 01:21:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching by: {'deleted': False, 'project_id': 'b60fd2418cf34127830ceed618456a71'} {{(pid=65278) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:22 user devstack@n-api.service[65278]: DEBUG nova.compute.multi_cell_list [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 01:21:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-9b0fdc5e-3c10-4003-b89c-9b4d6be9e2cf tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.172390 Nov 28 01:21:22 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 418/1234] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 01:21:22 2023] GET /compute/v2.1/servers => generated 341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:21:22 user devstack@n-api.service[65277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ade77aca-264f-45a3-9dbe-9a2a4533a488] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 01:21:22 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:21:22 user devstack@n-api.service[65277]: Tue Nov 28 01:21:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b (ip 10.0.0.210) !!! Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:22 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:21:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-d0e2ebb7-815f-4fbd-b4fd-bfc1509ab67e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1534 microversion: 2.1 time: 0.238213 Nov 28 01:21:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 413/1235] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:21:22 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1534 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:21:25 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3186a30c-266c-418f-8c6e-f386e1ecc445"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:21:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:25 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6133721-5edc-44fc-97a9-e940e29d4b64] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 50786. Nov 28 01:21:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-8a5010cb-2de2-4a61-bbb7-78452546be01 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271236 Nov 28 01:21:25 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 405/1236] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:21:25 2023] POST /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:39 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:21:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-27c3dc7d-d156-4e6f-ae47-272f1e57c1ea tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1580 microversion: 2.1 time: 0.218481 Nov 28 01:21:39 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 419/1237] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:21:39 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1580 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:21:40 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:40 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:40 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] [ade77aca-264f-45a3-9dbe-9a2a4533a488] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 39142. Nov 28 01:21:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] Creating event network-changed:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:40 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-50c58041-a330-4b88-9a2c-57e7936f27e6 req-bb46beba-7f60-4eab-91d0-edbba3b69c8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095278 Nov 28 01:21:40 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 414/1238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:21:42 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 28 01:21:42 user devstack@n-api.service[65276]: Tue Nov 28 01:21:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/action (ip 10.0.0.210) !!! Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1272274839"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:42 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:43 user devstack@n-api.service[65276]: INFO nova.network.security_group_api [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Adding security group 66522746-613b-4be8-a25d-e27bf2f6ea55 to port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 Nov 28 01:21:43 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-22981d92-2f37-47a2-9924-3e344957a661 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/action" status: 202 len: 0 microversion: 2.1 time: 0.569202 Nov 28 01:21:43 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 406/1239] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:21:42 2023] POST /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:21:43 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:43 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:43 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] Creating event network-changed:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:43 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a5051e73-ccc8-4f2b-8c28-fe5f64bf5538 req-d3f5b7e5-0529-405a-8540-66a4667c6588 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033517 Nov 28 01:21:43 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 415/1240] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:21:43 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:21:43 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fafb74bd-995d-4e8d-8145-6e2e5521475a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1745 microversion: 2.1 time: 0.292903 Nov 28 01:21:43 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 420/1241] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:21:43 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1745 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:21:47 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:47 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:21:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:47 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-82fc6432-56c8-4d25-b1f8-be21f0079979 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/action" status: 202 len: 0 microversion: 2.1 time: 0.094514 Nov 28 01:21:47 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 407/1242] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:21:47 2023] POST /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:47 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:21:47 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-9697f5f9-4736-4db4-bcc1-6d6684be21d8 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1747 microversion: 2.1 time: 0.262212 Nov 28 01:21:47 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 416/1243] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:21:47 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1747 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:21:48 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-unplugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:48 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:48 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] Creating event network-vif-unplugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:48 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-77cc2e84-7bc6-4f09-b795-4e83b73c1f95 req-55811a1e-ee2e-4ab0-a0df-32940b0b55f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030584 Nov 28 01:21:48 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 421/1244] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:21:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:21:50 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}, {"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}, {"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}, {"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-unplugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}, {"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:50 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Creating event network-vif-unplugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:50 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-6279d21f-5296-47fc-9103-f8ab50728be0 req-3e9baf2e-dab6-423e-9325-e9a078e0b201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035192 Nov 28 01:21:50 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 408/1245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:21:50 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:21:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:53 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a9d286c9-d4d5-45a8-b32a-8376d75a1ff9 req-44cf2e05-912a-4636-b26f-4292b1e9c644 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047427 Nov 28 01:21:53 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 417/1246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:21:55 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:21:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:21:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:21:55 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:21:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:21:55 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-67af7d0b-3f7d-4799-90f1-ae3e4597ab62 req-89a0bfc7-3e07-4e30-9065-355e64ad1d72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033589 Nov 28 01:21:55 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 422/1247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:21:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:22:37 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:22:38 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:22:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-5f86059c-f356-4122-b7b3-8040336b0d47 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1745 microversion: 2.1 time: 0.236881 Nov 28 01:22:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 409/1248] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:22:37 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=12 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1272274839"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:23:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:23:39 user devstack@n-api.service[65277]: INFO nova.network.security_group_api [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Removing security group 66522746-613b-4be8-a25d-e27bf2f6ea55 from port 58ee7f1d-9559-46d2-bda9-ed31cbb522f7 Nov 28 01:23:39 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-af058aed-89ad-48aa-a9af-1e9b6b150cb6 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/action" status: 202 len: 0 microversion: 2.1 time: 1.130506 Nov 28 01:23:39 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 418/1249] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:23:38 2023] POST /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:23:39 user devstack@n-api.service[65278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c5d6a7e-3d80-483e-ae8a-f0653bba0fb1] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 01:23:39 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:23:39 user devstack@n-api.service[65278]: Tue Nov 28 01:23:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 01:23:39 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:23:39 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=16 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:23:39 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:23:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:23:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:23:39 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:23:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] Creating event network-changed:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:23:39 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-8538de11-1fd0-42d6-97ce-2c35566e57db req-5dcafcb6-e413-46d0-bcdc-7a0c793787a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042514 Nov 28 01:23:39 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 423/1250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:23:40 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'services' on Instance uuid 169464fe-1c40-4704-b901-1788c2d6860b {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:23:40 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-aa2906f5-bd13-44e1-a64b-1530da50b325 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments/3186a30c-266c-418f-8c6e-f386e1ecc445" status: 202 len: 0 microversion: 2.1 time: 0.183211 Nov 28 01:23:40 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 410/1251] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:23:40 2023] DELETE /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments/3186a30c-266c-418f-8c6e-f386e1ecc445 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:23:40 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:23:40 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:23:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:23:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:23:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:23:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:23:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:23:40 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:23:41 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-979560b0-be8c-4775-bbc9-73e895386eb1 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054014 Nov 28 01:23:41 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 419/1252] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:23:40 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:23:41 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:23:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:23:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:23:41 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:23:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] Creating event network-changed:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:23:41 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-402a3ee0-b89a-4cb0-ac6e-7c328f3f50e8 req-0650731c-2432-43f7-b35f-150f59a91cde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031460 Nov 28 01:23:41 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 424/1253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-0d476404-9ab6-4bb9-97c5-ccdf7ea3b768 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101627 Nov 28 01:24:31 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 411/1254] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:24:31 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=10 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:31 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] HTTP exception thrown: Instance 169464fe-1c40-4704-b901-1788c2d6860b is not attached to volume 3186a30c-266c-418f-8c6e-f386e1ecc445 Nov 28 01:24:31 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Returning 404 to user: Instance 169464fe-1c40-4704-b901-1788c2d6860b is not attached to volume 3186a30c-266c-418f-8c6e-f386e1ecc445 {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:24:31 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c4f31418-ec60-43d6-9f86-1027f434ea8c tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments/3186a30c-266c-418f-8c6e-f386e1ecc445" status: 404 len: 154 microversion: 2.1 time: 0.143069 Nov 28 01:24:31 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 420/1255] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:24:31 2023] DELETE /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b/os-volume_attachments/3186a30c-266c-418f-8c6e-f386e1ecc445 => generated 154 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:24:34 user devstack@n-api.service[65278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c5d6a7e-3d80-483e-ae8a-f0653bba0fb1] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Going to try to terminate instance {{(pid=65278) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:24:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-abd5b3b4-b9d2-4cfd-9642-3e0dece3168b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 204 len: 0 microversion: 2.1 time: 0.120448 Nov 28 01:24:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 425/1256] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:24:34 2023] DELETE /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:24:34 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:24:34 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:24:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:34 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:34 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-unplugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:24:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:34 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:34 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] Creating event network-vif-unplugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:24:34 user devstack@n-api.service[65277]: ERROR oslo.messaging._drivers.impl_rabbit [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] [4351be9c-4669-4e7e-a3db-7c95d5f02d7d] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 01:24:35 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:24:35 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-b8379c40-1df3-47ca-9bbb-304fcaceae94 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 200 len: 1540 microversion: 2.1 time: 0.389294 Nov 28 01:24:35 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 412/1257] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:24:34 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 1540 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:24:35 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] [4351be9c-4669-4e7e-a3db-7c95d5f02d7d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45044. Nov 28 01:24:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-b1a88235-5b6f-44de-b9f3-2daa144e9301 req-4776ea65-5e21-4929-92cc-289538d87852 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.048355 Nov 28 01:24:36 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 421/1258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:24:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:24:36 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] [5c5d6a7e-3d80-483e-ae8a-f0653bba0fb1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 45054. Nov 28 01:24:36 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-f69dab9e-828f-452b-ac63-c2d8891994ee req-d5abe18f-36aa-41cd-bbdf-15392bf8e7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-deleted", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:24:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f69dab9e-828f-452b-ac63-c2d8891994ee req-d5abe18f-36aa-41cd-bbdf-15392bf8e7b8 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f69dab9e-828f-452b-ac63-c2d8891994ee req-d5abe18f-36aa-41cd-bbdf-15392bf8e7b8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:36 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-f69dab9e-828f-452b-ac63-c2d8891994ee req-d5abe18f-36aa-41cd-bbdf-15392bf8e7b8 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-f69dab9e-828f-452b-ac63-c2d8891994ee req-d5abe18f-36aa-41cd-bbdf-15392bf8e7b8 service nova] Creating event network-vif-deleted:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:24:36 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-f69dab9e-828f-452b-ac63-c2d8891994ee req-d5abe18f-36aa-41cd-bbdf-15392bf8e7b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093562 Nov 28 01:24:36 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 426/1259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:24:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:24:38 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169464fe-1c40-4704-b901-1788c2d6860b", "name": "network-vif-plugged", "status": "completed", "tag": "58ee7f1d-9559-46d2-bda9-ed31cbb522f7"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:24:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:24:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:24:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:24:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] Creating event network-vif-plugged:58ee7f1d-9559-46d2-bda9-ed31cbb522f7 for instance 169464fe-1c40-4704-b901-1788c2d6860b on user Nov 28 01:24:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-fb93fe02-ed61-4c9d-9d6d-b4850e65a524 req-96da3792-f06f-4a91-b70d-d32a230d2a9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028126 Nov 28 01:24:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 413/1260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:24:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=8 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 169464fe-1c40-4704-b901-1788c2d6860b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:25:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] HTTP exception thrown: Instance 169464fe-1c40-4704-b901-1788c2d6860b could not be found. Nov 28 01:25:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Returning 404 to user: Instance 169464fe-1c40-4704-b901-1788c2d6860b could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:25:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-3c0af303-8b53-4ab5-beda-301d68c22742 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b" status: 404 len: 111 microversion: 2.1 time: 0.037297 Nov 28 01:25:25 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 422/1261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:25:25 2023] GET /compute/v2.1/servers/169464fe-1c40-4704-b901-1788c2d6860b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:25:25 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:25:25 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:25:25 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e210d8b3-c941-4ab3-9e70-6cd5fd064b8a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '.version_select at 0x7f4972d54dc0>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:25:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e210d8b3-c941-4ab3-9e70-6cd5fd064b8a tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-118115395" status: 202 len: 0 microversion: 2.1 time: 0.043722 Nov 28 01:25:25 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 427/1262] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Nov 28 01:25:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-118115395 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:25:27 user devstack@n-api.service[65276]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6133721-5edc-44fc-97a9-e940e29d4b64] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 28 01:25:27 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:25:27 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=14 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:25:27 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-e8e50f7e-bc2f-4e8b-a5dd-48edb6cf1640 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'create', calling method: .version_select at 0x7f4972dd2f80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1936314097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKk0HMutZ3A7ZcKNBcqzYb2VbFeXHKOMxlkuRwObh2Oe2mwtlTpGXIpQQR7Mgy/j9iU2B54VME97nsb2V2QJpVr1s0iPWYIVi2Du6e0eOYgS6kJvy0AsnOQV1yutIdb+A=="}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:25:27 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-e8e50f7e-bc2f-4e8b-a5dd-48edb6cf1640 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting quotas for project b60fd2418cf34127830ceed618456a71. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:25:27 user devstack@n-api.service[65276]: DEBUG nova.quota [None req-e8e50f7e-bc2f-4e8b-a5dd-48edb6cf1640 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting quotas for user 9840cdc8142e46199dd32a7ea108ea4a and project b60fd2418cf34127830ceed618456a71. Resources: {'key_pairs'} {{(pid=65276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:25:27 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-e8e50f7e-bc2f-4e8b-a5dd-48edb6cf1640 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.064924 Nov 28 01:25:27 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 414/1263] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:25:27 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:25:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1106131125", "imageRef": "63ddbc17-c77e-4a11-a873-5d13f598a449", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-1936314097", "networks": [{"uuid": "8c0c53ac-6841-49ed-9cab-9b350f8fecbd"}]}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:25:27 user devstack@n-api.service[65277]: DEBUG nova.network.neutron [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] validate_networks() for [('8c0c53ac-6841-49ed-9cab-9b350f8fecbd', None, None, None, None, None)] {{(pid=65277) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image limits 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Flavor pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Image pref 0:0:0 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.virt.hardware [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting quotas for project b60fd2418cf34127830ceed618456a71. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Getting quotas for user 9840cdc8142e46199dd32a7ea108ea4a and project b60fd2418cf34127830ceed618456a71. Resources: {'cores', 'instances', 'ram'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Going to run 1 instances... {{(pid=65277) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:25:28 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63ddbc17-c77e-4a11-a873-5d13f598a449',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:25:28 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-819d845d-76ae-4b9b-bf27-247b80232164 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.852207 Nov 28 01:25:28 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 423/1264] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:25:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:25:28 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-ac0af6e8-e0f8-4383-b230-51f74fd6815f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:25:28 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-ac0af6e8-e0f8-4383-b230-51f74fd6815f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:25:28 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-ac0af6e8-e0f8-4383-b230-51f74fd6815f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:25:28 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-ac0af6e8-e0f8-4383-b230-51f74fd6815f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1251 microversion: 2.1 time: 0.137692 Nov 28 01:25:28 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 428/1265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:25:28 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1251 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:25:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:25:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:25:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:25:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:25:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] Creating event network-changed:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:25:31 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6133721-5edc-44fc-97a9-e940e29d4b64] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 56538. Nov 28 01:25:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-7ab62870-a63d-4035-902f-24bfd4503da9 req-64d9556f-d5e6-4826-be8e-ad8670d81af7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033689 Nov 28 01:25:31 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 415/1266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:25:33 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-plugged", "status": "completed", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:25:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:25:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:25:33 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:25:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] Creating event network-vif-plugged:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:25:33 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-8a24e354-eb8c-46d3-b721-9ac5801e70d6 req-95f35ec8-ef50-4efd-bf53-9acdda6f0f8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137563 Nov 28 01:25:33 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 424/1267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:25:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:25:35 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-plugged", "status": "completed", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:25:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:25:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:25:35 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:25:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] Creating event network-vif-plugged:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:25:35 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-55b035a2-620e-4bd9-adbd-255f2cf0f9ce req-a54e717f-a1dc-4113-bf9c-41bf1c01898b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036150 Nov 28 01:25:35 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 429/1268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:25:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:26:18 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:26:18 user devstack@n-api.service[65276]: Tue Nov 28 01:26:18 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b (ip 10.0.0.210) !!! Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:26:18 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:26:18 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-8676e7ae-266d-4f33-9f68-08cc6925a556 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1535 microversion: 2.1 time: 0.205584 Nov 28 01:26:18 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 416/1269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:26:18 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1535 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:27:19 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:27:19 user devstack@n-api.service[65277]: Tue Nov 28 01:27:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b (ip 10.0.0.210) !!! Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ade77aca-264f-45a3-9dbe-9a2a4533a488] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:19 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:27:19 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-e77d28fc-d782-4a70-a409-a79f5c0b7dfc tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1535 microversion: 2.1 time: 0.329346 Nov 28 01:27:19 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 425/1270] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:27:19 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1535 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Searching by: {'deleted': False, 'project_id': 'b60fd2418cf34127830ceed618456a71'} {{(pid=65278) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:19 user devstack@n-api.service[65278]: DEBUG nova.compute.multi_cell_list [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 01:27:19 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6baa9bb1-b13d-4b9e-a2ea-857fe41673e3 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.087178 Nov 28 01:27:19 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 430/1271] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 01:27:19 2023] GET /compute/v2.1/servers => generated 341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:19 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:27:19 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-5aa6e235-0a17-44a7-850c-a396d7a95879 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1535 microversion: 2.1 time: 0.216151 Nov 28 01:27:19 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 417/1272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:27:19 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1535 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:27:22 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de772352-1a57-4511-9b60-8a9e89341b97"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:27:22 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:27:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:22 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:22 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] [ade77aca-264f-45a3-9dbe-9a2a4533a488] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41972. Nov 28 01:27:22 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-85888f5f-ffe1-47b9-9588-b4b8dd6e587d tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283338 Nov 28 01:27:22 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 426/1273] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:27:22 2023] POST /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:34 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:27:34 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-e0c861f1-e266-45ef-8f6d-e9039921156b tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1581 microversion: 2.1 time: 0.229652 Nov 28 01:27:34 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 431/1274] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:27:34 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1581 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:27:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:27:36 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:36 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:36 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] Creating event network-changed:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:27:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-5f648fb8-1e54-41eb-808b-84e9758de4dd req-a92290d1-e187-49ea-bf80-4571bf427df1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039702 Nov 28 01:27:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 418/1275] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:27:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1128613593"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:37 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:38 user devstack@n-api.service[65277]: INFO nova.network.security_group_api [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Adding security group f8eec6e3-d054-4b31-9800-fc94df677d79 to port 827702b3-6c9e-4d07-8324-598c38a33808 Nov 28 01:27:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-758d74db-a4f1-4ee3-ad30-986f4715397e tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/action" status: 202 len: 0 microversion: 2.1 time: 0.645113 Nov 28 01:27:38 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 427/1276] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:27:37 2023] POST /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:38 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:27:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:38 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] Creating event network-changed:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:27:38 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-0fd00e0d-7c5c-4629-8f95-ad5a39344e38 req-d1a7df82-ed33-40ca-b4e1-5e248302af29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103128 Nov 28 01:27:38 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 419/1277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:27:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:27:38 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:27:38 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-be223e9e-0028-446b-8819-313bfa9a1d6f tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1746 microversion: 2.1 time: 0.313698 Nov 28 01:27:38 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 432/1278] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:27:38 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1746 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:27:38 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:27:38 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:27:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:38 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:38 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-1d559982-9f32-4cf7-8175-596418a7e624 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/action" status: 202 len: 0 microversion: 2.1 time: 0.092710 Nov 28 01:27:38 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 428/1279] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:27:38 2023] POST /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:27:38 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:27:38 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:27:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:39 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:39 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:27:39 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-4ab783b1-8867-4fd8-a478-5af75b27cf72 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1738 microversion: 2.1 time: 0.224913 Nov 28 01:27:39 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 420/1280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:27:38 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:27:42 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-unplugged", "status": "completed", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:27:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:42 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:42 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] Creating event network-vif-unplugged:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:27:42 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-2e170cf1-52c1-49bf-8adb-976b8175d390 req-de80fd4e-7b3b-4c16-abbf-abe685b04cc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030894 Nov 28 01:27:42 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 433/1281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:27:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:27:44 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-plugged", "status": "completed", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:27:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:44 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] Creating event network-vif-plugged:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:27:44 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-f524a2d5-2ed0-4ad7-882a-08e81082ef28 req-5cf7ed9a-ceb1-4540-b774-162e2e35c802 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046417 Nov 28 01:27:44 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 429/1282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:27:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:27:46 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-plugged", "status": "completed", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}, {"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-plugged", "status": "completed", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:27:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:27:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:27:46 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:27:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Creating event network-vif-plugged:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:27:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] Creating event network-vif-plugged:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:27:46 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-ab672c77-95d8-421d-a57c-da55532928e7 req-3fdf8a6f-cf13-4fd8-b4d6-7248dbd763b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032436 Nov 28 01:27:46 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 421/1283] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:27:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:28:29 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:28:29 user devstack@n-api.service[65278]: Tue Nov 28 01:28:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b (ip 10.0.0.210) !!! Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=14 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:28:29 user devstack@n-api.service[65278]: DEBUG nova.policy [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65278) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:28:29 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fdf67c5e-108d-4504-a63b-0a83aa380539 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1746 microversion: 2.1 time: 0.247659 Nov 28 01:28:29 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 434/1284] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:28:29 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1746 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:29:29 user devstack@n-api.service[65277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ade77aca-264f-45a3-9dbe-9a2a4533a488] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 28 01:29:29 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:29:29 user devstack@n-api.service[65277]: Tue Nov 28 01:29:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/action (ip 10.0.0.210) !!! Nov 28 01:29:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:29:29 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:29:30 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1128613593"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:29:30 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:29:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:29:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:29:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:29:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:29:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:29:30 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:29:30 user devstack@n-api.service[65277]: INFO nova.network.security_group_api [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Removing security group f8eec6e3-d054-4b31-9800-fc94df677d79 from port 827702b3-6c9e-4d07-8324-598c38a33808 Nov 28 01:29:30 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-dc11ade3-9e8c-466a-8100-b3644734bb77 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/action" status: 202 len: 0 microversion: 2.1 time: 0.778426 Nov 28 01:29:30 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 430/1285] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 01:29:29 2023] POST /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:29:30 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:29:30 user devstack@n-api.service[65276]: Tue Nov 28 01:29:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 01:29:30 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:29:30 user devstack@n-api.service[65276]: Tue Nov 28 01:29:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 01:29:30 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:29:30 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=12 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:29:30 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:29:30 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:29:30 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:29:30 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:29:30 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] Creating event network-changed:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:29:30 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-6a74b6d6-4617-453f-9029-e209f9ead0de req-f39b1282-7d97-42c5-8f57-e478ac02d695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040778 Nov 28 01:29:30 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 422/1286] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:29:31 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:29:31 user devstack@n-api.service[65278]: Tue Nov 28 01:29:31 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments/de772352-1a57-4511-9b60-8a9e89341b97 (ip 10.0.0.210) !!! Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:29:31 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:29:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:29:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:29:31 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:29:31 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] [ade77aca-264f-45a3-9dbe-9a2a4533a488] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 55472. Nov 28 01:29:31 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] Creating event network-changed:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:29:31 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a9acf1e1-f810-4ee0-beb7-2af8ff8e1783 req-8de20445-2757-44ff-aa53-2179e43358ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032427 Nov 28 01:29:31 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 431/1287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:29:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:29:31 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lazy-loading 'services' on Instance uuid 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:29:31 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-010971d9-bb26-44b1-828b-7b5bcdc4f794 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments/de772352-1a57-4511-9b60-8a9e89341b97" status: 202 len: 0 microversion: 2.1 time: 0.242880 Nov 28 01:29:31 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 435/1288] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:29:31 2023] DELETE /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments/de772352-1a57-4511-9b60-8a9e89341b97 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:29:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:29:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:29:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:29:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:29:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:29:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:29:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:29:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:29:31 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-9274a798-868a-43b7-a98c-23949bebb0ae tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044412 Nov 28 01:29:31 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 423/1289] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:29:31 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:21 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:21 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-360192a8-8158-4ebc-934d-e54cd96b1115 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052802 Nov 28 01:30:21 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 432/1290] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:30:21 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:30:21 user devstack@n-api.service[65278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c5d6a7e-3d80-483e-ae8a-f0653bba0fb1] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] HTTP exception thrown: Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b is not attached to volume de772352-1a57-4511-9b60-8a9e89341b97 Nov 28 01:30:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Returning 404 to user: Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b is not attached to volume de772352-1a57-4511-9b60-8a9e89341b97 {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:30:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-4b85335f-11b1-429a-8c25-f541f9d56178 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments/de772352-1a57-4511-9b60-8a9e89341b97" status: 404 len: 154 microversion: 2.1 time: 0.099218 Nov 28 01:30:21 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 436/1291] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:30:21 2023] DELETE /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b/os-volume_attachments/de772352-1a57-4511-9b60-8a9e89341b97 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=4 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=8 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:25 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:30:25 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-ce4a66e3-1ffd-4ead-8721-49ee952a80a4 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 204 len: 0 microversion: 2.1 time: 0.114847 Nov 28 01:30:25 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 424/1292] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:30:25 2023] DELETE /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:25 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-unplugged", "status": "completed", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:30:25 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] [5c5d6a7e-3d80-483e-ae8a-f0653bba0fb1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52628. Nov 28 01:30:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:25 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:25 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9840cdc8142e46199dd32a7ea108ea4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60fd2418cf34127830ceed618456a71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:30:25 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-c213e95b-d372-4d4f-a631-5e22659c8899 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 200 len: 1541 microversion: 2.1 time: 0.270472 Nov 28 01:30:25 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 433/1293] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:30:25 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 1541 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:30:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] Creating event network-vif-unplugged:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:30:25 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-92173a39-c4b0-477a-8eba-c1a51afe68c3 req-84cabedb-8083-492b-bdd2-c8266210df78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060928 Nov 28 01:30:25 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 437/1294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:30:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 01:30:27 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-81c044a1-ba4b-4656-9aa9-2554ca63f7d6 req-87abc904-cddf-41b2-a1af-0350a003f904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-deleted", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:30:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-81c044a1-ba4b-4656-9aa9-2554ca63f7d6 req-87abc904-cddf-41b2-a1af-0350a003f904 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-81c044a1-ba4b-4656-9aa9-2554ca63f7d6 req-87abc904-cddf-41b2-a1af-0350a003f904 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:27 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-81c044a1-ba4b-4656-9aa9-2554ca63f7d6 req-87abc904-cddf-41b2-a1af-0350a003f904 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:27 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-81c044a1-ba4b-4656-9aa9-2554ca63f7d6 req-87abc904-cddf-41b2-a1af-0350a003f904 service nova] Creating event network-vif-deleted:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:30:27 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-81c044a1-ba4b-4656-9aa9-2554ca63f7d6 req-87abc904-cddf-41b2-a1af-0350a003f904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158377 Nov 28 01:30:27 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 425/1295] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:30:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:30:27 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eeb3fc2-2a1a-4496-a74a-acda3bb9965b", "name": "network-vif-plugged", "status": "completed", "tag": "827702b3-6c9e-4d07-8324-598c38a33808"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:30:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:30:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:30:27 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:30:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] Creating event network-vif-plugged:827702b3-6c9e-4d07-8324-598c38a33808 for instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b on user Nov 28 01:30:27 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a693854b-9359-458a-9078-40ffd6a0623e req-ade8a5f4-dce0-44fa-9d0d-5e974f63c40e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030425 Nov 28 01:30:27 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 434/1296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:30:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=8 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] [instance: 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:31:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.wsgi [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] HTTP exception thrown: Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b could not be found. Nov 28 01:31:15 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Returning 404 to user: Instance 8eeb3fc2-2a1a-4496-a74a-acda3bb9965b could not be found. {{(pid=65278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:31:15 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-fc6df152-3ba3-47b2-9de2-12f5283816e9 tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b" status: 404 len: 111 microversion: 2.1 time: 0.033903 Nov 28 01:31:15 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 438/1297] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:31:15 2023] GET /compute/v2.1/servers/8eeb3fc2-2a1a-4496-a74a-acda3bb9965b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 01:31:15 user devstack@n-api.service[65276]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6133721-5edc-44fc-97a9-e940e29d4b64] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 01:31:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:31:15 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:31:15 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-59170162-e6ea-4434-9c7c-9b268ffcb3df tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] Calling method '.version_select at 0x7f4972dd0ca0>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:31:15 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-59170162-e6ea-4434-9c7c-9b268ffcb3df tempest-TestMinimumBasicScenario-1587536658 tempest-TestMinimumBasicScenario-1587536658-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1936314097" status: 202 len: 0 microversion: 2.1 time: 0.038104 Nov 28 01:31:15 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 426/1298] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Nov 28 01:31:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1936314097 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:31:59 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:31:59 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=14 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:31:59 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-a457a6bb-8727-4192-b8b4-f278aaad08f1 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Action: 'create', calling method: .version_select at 0x7f497056d090>, body: {"keypair": {"name": "tempest-keypair-1563997407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrz9f14teMjaRBkan8CfcpOatyvAA6p0hfNH4BGV/fO1fVHwG2RVkbP9SlqoB27mdUZy2DWZqGBTP9FXbcSTPfjOWc83gEMV8E/zluINlrJb+V2NZmY85Vyq5NBXrLSmw=="}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:31:59 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-a457a6bb-8727-4192-b8b4-f278aaad08f1 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting quotas for project 8cb9ba5299e44f8988062d107a3ba7e1. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:31:59 user devstack@n-api.service[65277]: DEBUG nova.quota [None req-a457a6bb-8727-4192-b8b4-f278aaad08f1 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting quotas for user d808e1f1fd2e4db891dc12d5f9d8f5e6 and project 8cb9ba5299e44f8988062d107a3ba7e1. Resources: {'key_pairs'} {{(pid=65277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:31:59 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-a457a6bb-8727-4192-b8b4-f278aaad08f1 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.359332 Nov 28 01:31:59 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 435/1299] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 01:31:59 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:32:02 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-950309669", "imageRef": "0eca691f-8ae7-4ede-a543-e4f526783da7", "flavorRef": "1", "key_name": "tempest-keypair-1563997407", "security_groups": [{"name": "tempest-secgroup-smoke-1455580375"}, {"name": "tempest-securitygroup--1247248596"}], "networks": [{"uuid": "45fc1afa-7b94-488c-afea-48be247a070f"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:32:02 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:32:02 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:32:02 user devstack@n-api.service[65278]: DEBUG nova.network.neutron [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] validate_networks() for [('45fc1afa-7b94-488c-afea-48be247a070f', None, None, None, None, None)] {{(pid=65278) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Flavor limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Image limits 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Flavor pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Image pref 0:0:0 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.virt.hardware [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting quotas for project 8cb9ba5299e44f8988062d107a3ba7e1. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.quota [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Getting quotas for user d808e1f1fd2e4db891dc12d5f9d8f5e6 and project 8cb9ba5299e44f8988062d107a3ba7e1. Resources: {'cores', 'instances', 'ram'} {{(pid=65278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Going to run 1 instances... {{(pid=65278) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 01:32:03 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0eca691f-8ae7-4ede-a543-e4f526783da7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 01:32:03 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6db675cd-47c6-40ba-8bb8-9e52cd769f4a tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 451 microversion: 2.1 time: 0.952514 Nov 28 01:32:03 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 439/1300] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 01:32:02 2023] POST /compute/v2.1/servers => generated 451 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 01:32:03 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:32:03 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-f05e0d36-69b7-4af7-8d43-e9833b6d6020 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:32:03 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-f05e0d36-69b7-4af7-8d43-e9833b6d6020 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:32:03 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6133721-5edc-44fc-97a9-e940e29d4b64] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 44728. Nov 28 01:32:03 user devstack@n-api.service[65276]: DEBUG nova.policy [None req-f05e0d36-69b7-4af7-8d43-e9833b6d6020 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd808e1f1fd2e4db891dc12d5f9d8f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb9ba5299e44f8988062d107a3ba7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65276) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:32:03 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-f05e0d36-69b7-4af7-8d43-e9833b6d6020 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6" status: 200 len: 1235 microversion: 2.1 time: 0.165969 Nov 28 01:32:03 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 427/1301] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:32:03 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6 => generated 1235 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:32:06 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c430513e-9f72-4eae-a522-1b000ef4dab6", "tag": "10226b33-a013-4cde-9de0-9f0080ec8a41"}]} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:32:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:32:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:32:06 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:32:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.compute.server_external_events [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] Creating event network-changed:10226b33-a013-4cde-9de0-9f0080ec8a41 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 on user Nov 28 01:32:06 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [req-a8e71cfb-b893-4803-b125-8c2c58854302 req-ebc24bda-89a7-4802-856f-1fb86445712c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068300 Nov 28 01:32:06 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 436/1302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:32:08 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c430513e-9f72-4eae-a522-1b000ef4dab6", "name": "network-vif-plugged", "status": "completed", "tag": "10226b33-a013-4cde-9de0-9f0080ec8a41"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:32:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:32:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:32:08 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:32:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] Creating event network-vif-plugged:10226b33-a013-4cde-9de0-9f0080ec8a41 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 on user Nov 28 01:32:08 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-5ee0385b-0e05-4631-a3df-d08b065098c8 req-c9f18ea0-183b-4ec5-9f44-e55d495499ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161652 Nov 28 01:32:08 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 440/1303] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:32:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:32:10 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c430513e-9f72-4eae-a522-1b000ef4dab6", "name": "network-vif-plugged", "status": "completed", "tag": "10226b33-a013-4cde-9de0-9f0080ec8a41"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:32:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:32:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:32:10 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:32:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] Creating event network-vif-plugged:10226b33-a013-4cde-9de0-9f0080ec8a41 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 on user Nov 28 01:32:10 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-e95b4a23-b51a-4313-a766-e7640c9c350a req-1d7d1b20-fa5c-4250-b77d-0e7d564f625c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050276 Nov 28 01:32:10 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 428/1304] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:32:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell0:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:32:53 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:32:54 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd808e1f1fd2e4db891dc12d5f9d8f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb9ba5299e44f8988062d107a3ba7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:32:54 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-8a75aa38-90ba-4a9d-8fc0-09f2aa5b026c tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6" status: 200 len: 1594 microversion: 2.1 time: 0.709711 Nov 28 01:32:54 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 437/1305] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:32:53 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6 => generated 1594 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell0:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:33:54 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:33:54 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-a3db3f31-5cde-4a05-a5e9-b84622671c09 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.395220 Nov 28 01:33:54 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 441/1306] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 01:33:54 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-interface => generated 282 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:33:55 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:33:55 user devstack@n-api.service[65276]: Tue Nov 28 01:33:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 01:33:55 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell0:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:55 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:55 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:55 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c430513e-9f72-4eae-a522-1b000ef4dab6", "tag": "10226b33-a013-4cde-9de0-9f0080ec8a41"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:33:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:33:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:33:55 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:33:55 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] Creating event network-changed:10226b33-a013-4cde-9de0-9f0080ec8a41 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 on user Nov 28 01:33:55 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-10378566-1309-4083-b21a-cf0bd188503e req-5de4ac59-0957-4f93-a6e2-192d9ce093e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045060 Nov 28 01:33:55 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 429/1307] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:33:55 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd808e1f1fd2e4db891dc12d5f9d8f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb9ba5299e44f8988062d107a3ba7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:33:55 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-bb20e9ca-a291-43c6-8c8b-fefb9ea1c4b6 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6" status: 200 len: 1594 microversion: 2.1 time: 0.247919 Nov 28 01:33:55 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 438/1308] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:33:55 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6 => generated 1594 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:33:58 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12736964-6b8b-4a18-a355-e4da9f94ad17"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:33:58 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:33:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:33:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:33:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:33:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:33:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:33:58 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:33:59 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-994f970f-bf48-45a2-b66a-39d9e4319d62 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329051 Nov 28 01:33:59 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 442/1309] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:33:58 2023] POST /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:34:20 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'services' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:34:20 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-cd12a1ec-02b2-4266-9bbd-5d9c66e46349 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments/12736964-6b8b-4a18-a355-e4da9f94ad17" status: 202 len: 0 microversion: 2.1 time: 0.172412 Nov 28 01:34:20 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 430/1310] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:34:20 2023] DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments/12736964-6b8b-4a18-a355-e4da9f94ad17 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:34:20 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:34:20 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-06c15445-58f7-4c7e-bbff-0f1df1d8bb67 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052210 Nov 28 01:34:20 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 439/1311] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:34:20 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:35:11 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:35:11 user devstack@n-api.service[65278]: Tue Nov 28 01:35:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 01:35:11 user devstack@n-api.service[65278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:35:11 user devstack@n-api.service[65278]: Tue Nov 28 01:35:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=4 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:35:11 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:35:11 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-abf14bd8-e5b6-4cce-b773-4959ec3b9029 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062907 Nov 28 01:35:11 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 443/1312] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:35:11 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:35:13 user devstack@n-api.service[65276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:35:13 user devstack@n-api.service[65276]: Tue Nov 28 01:35:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6243f285-db37-4867-99b4-050f06888d3a"}} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:35:13 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:35:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-a1385a61-634e-4137-a805-1c6871184f89 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388860 Nov 28 01:35:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 431/1313] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:35:13 2023] POST /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:35:24 user devstack@n-api.service[65277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ade77aca-264f-45a3-9dbe-9a2a4533a488] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:35:24 user devstack@n-api.service[65277]: DEBUG nova.objects.instance [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'services' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=65277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:35:24 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-78b7688f-fd11-4381-9a92-1a007d61306d tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments/6243f285-db37-4867-99b4-050f06888d3a" status: 202 len: 0 microversion: 2.1 time: 0.291582 Nov 28 01:35:24 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 440/1314] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:35:24 2023] DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments/6243f285-db37-4867-99b4-050f06888d3a => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:35:24 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:35:24 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-f0a39791-ffc1-46c6-b8ee-762edcbd7574 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062808 Nov 28 01:35:24 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 444/1315] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:35:24 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:36:14 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:36:14 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c7f7d5b6-782e-4891-9a77-24c0dc056d08 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049529 Nov 28 01:36:14 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 432/1316] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:36:14 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23385482-4420-4214-afd9-61159b8296a4"}} {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:36:17 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:36:17 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] [ade77aca-264f-45a3-9dbe-9a2a4533a488] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 38436. Nov 28 01:36:17 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-89aae530-9207-42b0-9c57-ee6a91c85619 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312696 Nov 28 01:36:17 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 441/1317] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:36:17 2023] POST /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:36:28 user devstack@n-api.service[65278]: DEBUG nova.objects.instance [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'services' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=65278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:36:28 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-0eb9ecf4-e32d-4831-a965-5dfa15cdbeef tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments/23385482-4420-4214-afd9-61159b8296a4" status: 202 len: 0 microversion: 2.1 time: 0.278750 Nov 28 01:36:28 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 445/1318] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:36:28 2023] DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments/23385482-4420-4214-afd9-61159b8296a4 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:36:28 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:36:28 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-09691ebd-2907-4b37-8431-ed6a38ea55df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057912 Nov 28 01:36:28 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 433/1319] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:36:28 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:37:18 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:37:18 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-858cb92f-84b1-48f3-8029-09f5f84da0df tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151959 Nov 28 01:37:18 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 442/1320] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:37:18 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77272474-7175-44e9-8a14-8cb66af9890d"}} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:37:21 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:37:21 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-90e1b885-3ee9-47a3-9b37-a921e4383a75 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446618 Nov 28 01:37:21 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 446/1321] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 01:37:21 2023] POST /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=6 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:37:31 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:37:32 user devstack@n-api.service[65276]: DEBUG nova.objects.instance [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lazy-loading 'services' on Instance uuid c430513e-9f72-4eae-a522-1b000ef4dab6 {{(pid=65276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 01:37:32 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-c274b850-3b82-4891-970b-bc65d3a0ca92 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments/77272474-7175-44e9-8a14-8cb66af9890d" status: 202 len: 0 microversion: 2.1 time: 0.230603 Nov 28 01:37:32 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 434/1322] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 01:37:31 2023] DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments/77272474-7175-44e9-8a14-8cb66af9890d => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:37:32 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:37:32 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-327e4d5e-becd-494b-ae49-eeacd6418b7e tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056290 Nov 28 01:37:32 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 443/1323] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:37:32 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG nova.compute.api [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65278) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:22 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:22 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [None req-6e4fc531-82d9-4c13-a44d-b1ffe08ffb9f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057894 Nov 28 01:38:22 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 447/1324] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 01:38:22 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=2 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65276) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:45 user devstack@n-api.service[65276]: DEBUG nova.compute.api [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Going to try to terminate instance {{(pid=65276) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 01:38:45 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-26e80045-8c45-47e8-8fbe-6982d23c2383 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6" status: 204 len: 0 microversion: 2.1 time: 0.126049 Nov 28 01:38:45 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 435/1325] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 01:38:45 2023] DELETE /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 01:38:45 user devstack@n-api.service[65277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 01:38:45 user devstack@n-api.service[65277]: Tue Nov 28 01:38:45 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6 (ip 10.0.0.210) !!! Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=2 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:45 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_api:SELECT=2 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:38:45 user devstack@n-api.service[65278]: DEBUG dbcounter [-] [65278] Writing DB stats nova_cell1:SELECT=6 {{(pid=65278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:38:45 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c430513e-9f72-4eae-a522-1b000ef4dab6", "name": "network-vif-unplugged", "status": "completed", "tag": "10226b33-a013-4cde-9de0-9f0080ec8a41"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:38:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:45 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:45 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] Creating event network-vif-unplugged:10226b33-a013-4cde-9de0-9f0080ec8a41 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 on user Nov 28 01:38:45 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-28cb4c40-04fc-4552-97fa-19ec253818cf req-9bcc8081-2709-4d70-a1e1-76abfe313f10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106980 Nov 28 01:38:45 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 448/1326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:38:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:38:45 user devstack@n-api.service[65277]: DEBUG nova.policy [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd808e1f1fd2e4db891dc12d5f9d8f5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb9ba5299e44f8988062d107a3ba7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65277) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 01:38:46 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-33bf687c-8687-440c-b20c-3c8212dfd689 tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6" status: 200 len: 1718 microversion: 2.1 time: 0.460043 Nov 28 01:38:46 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 444/1327] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:38:45 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6 => generated 1718 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 01:38:47 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [req-7848046f-39a2-4335-a774-24cc50491adf req-ebcef91c-ec14-42d2-bf88-90276881aa41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c430513e-9f72-4eae-a522-1b000ef4dab6", "name": "network-vif-deleted", "tag": "10226b33-a013-4cde-9de0-9f0080ec8a41"}]} {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:38:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7848046f-39a2-4335-a774-24cc50491adf req-ebcef91c-ec14-42d2-bf88-90276881aa41 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7848046f-39a2-4335-a774-24cc50491adf req-ebcef91c-ec14-42d2-bf88-90276881aa41 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:47 user devstack@n-api.service[65276]: DEBUG oslo_concurrency.lockutils [req-7848046f-39a2-4335-a774-24cc50491adf req-ebcef91c-ec14-42d2-bf88-90276881aa41 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65276) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:47 user devstack@n-api.service[65276]: INFO nova.api.openstack.compute.server_external_events [req-7848046f-39a2-4335-a774-24cc50491adf req-ebcef91c-ec14-42d2-bf88-90276881aa41 service nova] Creating event network-vif-deleted:10226b33-a013-4cde-9de0-9f0080ec8a41 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 on user Nov 28 01:38:47 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [req-7848046f-39a2-4335-a774-24cc50491adf req-ebcef91c-ec14-42d2-bf88-90276881aa41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085561 Nov 28 01:38:47 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 436/1328] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:38:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:38:47 user devstack@n-api.service[65278]: DEBUG nova.api.openstack.wsgi [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c430513e-9f72-4eae-a522-1b000ef4dab6", "name": "network-vif-plugged", "status": "completed", "tag": "10226b33-a013-4cde-9de0-9f0080ec8a41"}]} {{(pid=65278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 01:38:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:38:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:38:47 user devstack@n-api.service[65278]: DEBUG oslo_concurrency.lockutils [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:38:48 user devstack@n-api.service[65278]: INFO nova.api.openstack.compute.server_external_events [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] Creating event network-vif-plugged:10226b33-a013-4cde-9de0-9f0080ec8a41 for instance c430513e-9f72-4eae-a522-1b000ef4dab6 on user Nov 28 01:38:48 user devstack@n-api.service[65278]: INFO nova.api.openstack.requestlog [req-b522a009-ad04-4941-a735-4d535349208e req-6a9c82ab-830b-4505-96f3-24eb9e740d70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066489 Nov 28 01:38:48 user devstack@n-api.service[65278]: [pid: 65278|app: 0|req: 449/1329] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 01:38:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '>' {{(pid=65277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG nova.compute.api [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] [instance: c430513e-9f72-4eae-a522-1b000ef4dab6] Fetching instance by UUID {{(pid=65277) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_api:SELECT=4 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG dbcounter [-] [65277] Writing DB stats nova_cell1:SELECT=6 {{(pid=65277) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Acquiring lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG oslo_concurrency.lockutils [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Lock "3099e656-1610-4c42-b3b1-20ed37c4bef8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65277) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 01:39:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.wsgi [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] HTTP exception thrown: Instance c430513e-9f72-4eae-a522-1b000ef4dab6 could not be found. Nov 28 01:39:36 user devstack@n-api.service[65277]: DEBUG nova.api.openstack.wsgi [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Returning 404 to user: Instance c430513e-9f72-4eae-a522-1b000ef4dab6 could not be found. {{(pid=65277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 01:39:36 user devstack@n-api.service[65277]: INFO nova.api.openstack.requestlog [None req-cce8f71e-5882-4f52-9a46-c70fc00ef75f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6" status: 404 len: 111 microversion: 2.1 time: 0.034328 Nov 28 01:39:36 user devstack@n-api.service[65277]: [pid: 65277|app: 0|req: 445/1330] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 01:39:36 2023] GET /compute/v2.1/servers/c430513e-9f72-4eae-a522-1b000ef4dab6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 01:39:36 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:39:36 user devstack@n-api.service[65276]: DEBUG dbcounter [-] [65276] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65276) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 01:39:36 user devstack@n-api.service[65276]: DEBUG nova.api.openstack.wsgi [None req-3cc2c389-4fd7-4ffc-a40a-95c54e42cf7f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] Calling method '.version_select at 0x7f4972c25510>' {{(pid=65276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 01:39:36 user devstack@n-api.service[65276]: INFO nova.api.openstack.requestlog [None req-3cc2c389-4fd7-4ffc-a40a-95c54e42cf7f tempest-SnapshotDataIntegrityTests-663058346 tempest-SnapshotDataIntegrityTests-663058346-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563997407" status: 202 len: 0 microversion: 2.1 time: 0.033591 Nov 28 01:39:36 user devstack@n-api.service[65276]: [pid: 65276|app: 0|req: 437/1331] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 01:39:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563997407 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)